-- Logs begin at Fri 2022-06-03 08:19:07 UTC, end at Fri 2022-06-03 09:31:25 UTC. -- Jun 03 08:55:42.072762 dv-cinder-812685-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 08:55:42.081377 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 08:55:42 2022] *** Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: nodename: dv-cinder-812685-8-iscsi Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: machine: x86_64 Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: clock source: unix Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: pcre jit disabled Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: detected number of CPU cores: 4 Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: current working directory: / Jun 03 08:55:42.083346 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: detected binary path: /usr/bin/uwsgi-core Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: your processes number limit is 47680 Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: your memory page size is 4096 bytes Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: detected max file descriptor number: 2048 Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: lock engine: pthread robust mutexes Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: thunder lock: enabled Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 08:55:42.084064 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 08:55:42.128600 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: Python main interpreter initialized at 0x55d908f709c0 Jun 03 08:55:42.128600 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: python threads support enabled Jun 03 08:55:42.128600 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: your server socket listen backlog is limited to 100 connections Jun 03 08:55:42.128600 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: your mercy for graceful operations on workers is 90 seconds Jun 03 08:55:42.128975 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 08:55:42.129052 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: *** Operational MODE: preforking *** Jun 03 08:55:42.129288 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: *** uWSGI is running in multiple interpreter mode *** Jun 03 08:55:42.129288 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: spawned uWSGI master process (pid: 103341) Jun 03 08:55:42.129483 dv-cinder-812685-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 08:55:42.131616 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 1 (pid: 103342, cores: 1) Jun 03 08:55:42.131616 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 2 (pid: 103343, cores: 1) Jun 03 08:55:42.131616 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 08:55:43.373419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 08:55:43.375214 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 08:55:44.101966 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:55:44.101966 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 03 08:55:44.102290 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:55:44.102290 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 03 08:55:44.105609 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:55:44.105609 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jun 03 08:55:44.105949 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:55:44.105949 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jun 03 08:55:46.815262 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 08:55:46.815858 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 08:55:46.816090 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 08:55:46.816456 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 08:55:46.816715 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 08:55:46.817207 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.817430 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.817756 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.818079 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.818401 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.818718 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.819038 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.819357 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.819689 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.819979 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.820291 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.820617 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-8-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.820949 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.821257 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.821569 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.821895 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.822202 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.822301 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 08:55:46.822662 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 08:55:46.822742 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.822820 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.823021 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 08:55:46.823301 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.823406 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 08:55:46.823637 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 08:55:46.823776 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.824100 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.824415 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.824751 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.825147 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.825467 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.825738 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.825963 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.826144 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.826428 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.826634 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.826815 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.827005 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.827206 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.827401 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.827917 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-8-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.828292 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.828498 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.828690 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.829052 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.829252 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.829407 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.829572 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.829732 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.830596 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.830818 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.830991 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-8-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.831277 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.831604 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.832013 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.832254 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.832597 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.832754 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.832930 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.833156 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.833287 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.833583 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.833712 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.833922 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834060 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834243 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834372 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834601 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834760 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.834903 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835085 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835222 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835415 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835542 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835711 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.835903 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836084 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836222 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836409 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836547 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836706 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.836835 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837021 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837159 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837350 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837486 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837672 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837808 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.837986 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838122 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838307 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838437 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-8-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838563 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838689 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.838880 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839019 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839238 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839376 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839509 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839727 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.839892 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840069 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840197 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840385 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840528 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840709 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.840921 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841051 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841173 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841396 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841526 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841651 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841786 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.841921 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.842078 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.842208 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.842405 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.842725 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.842855 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.843033 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.843281 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.843412 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.843650 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.843900 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.844034 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.844301 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.844611 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.844739 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.844865 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.845088 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.845220 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.845500 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.845683 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.845833 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.846164 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.846306 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.846450 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.846830 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.846971 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847167 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847307 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847495 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847632 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847832 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.847973 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848137 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848270 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848449 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848589 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848760 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.848888 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849071 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849225 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849445 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849573 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849697 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849829 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.849973 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850107 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850282 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850422 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850604 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850732 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.850931 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851060 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851243 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851385 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851646 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851814 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.851957 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852083 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852208 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852331 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852457 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852588 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852757 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.852887 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853066 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853203 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853374 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853512 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853684 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853818 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.853992 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854121 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854308 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854446 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854618 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854753 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.854925 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855064 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855248 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855385 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855571 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855700 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.855892 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856018 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856161 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856287 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856461 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856597 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.856787 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.857109 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.857419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.857726 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.858070 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.858195 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.858436 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.858805 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.859061 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.859361 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.859587 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.859716 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.859931 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.860061 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.860423 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.860767 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.861112 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.861441 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.861583 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.861788 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.861934 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862061 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862194 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862377 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862507 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862690 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.862968 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863099 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863299 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863428 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863612 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863743 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.863949 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864092 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864265 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864402 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864580 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864718 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.864918 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.865138 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.865267 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.865560 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.865721 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.865864 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.866184 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.866326 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.866529 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.866843 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.866973 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.867282 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.867421 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.867648 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.867998 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.868185 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.868633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.868775 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.869102 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.869231 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.869436 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.869581 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.869794 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.869937 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.870149 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.870310 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.870508 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.870644 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.870835 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.870967 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.871156 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.871286 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.871478 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.871608 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.871843 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.872031 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.872188 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.872353 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.872505 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.872664 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.872923 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.873069 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.873210 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.873361 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.873550 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.873699 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.873861 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.874008 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.874153 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.874302 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.874449 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.874609 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.874753 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.874896 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.875051 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.875198 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.875346 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.875518 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.875666 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.875834 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.875977 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.876141 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.876297 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:55:46.876460 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.876608 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.877279 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.877436 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.877573 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.877714 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.877914 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.878073 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.878727 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.878727 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.879040 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.879524 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.879725 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.879995 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.880340 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.880479 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.880731 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.880894 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.881083 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.881437 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.881775 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.882109 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.882441 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.882673 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.882854 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.883043 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.883231 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.883419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.883610 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.883927 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.884146 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.884335 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.884538 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.884749 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.884949 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.885166 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.885355 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.885538 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.885726 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.885909 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886083 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886282 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886471 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886471 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886818 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.886988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.887353 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.887530 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.887794 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.887994 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.887994 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.888394 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.888590 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.888590 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.888956 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.889154 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.889367 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.889576 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.889576 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.889939 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.890275 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.890275 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.890669 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.890894 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.891096 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.891309 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.891504 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.891712 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.891955 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.892182 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.893073 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.893286 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.893499 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.893698 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.893893 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.894096 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.894299 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.894512 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.894724 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.894926 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.895141 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.895340 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.895545 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.895744 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.895998 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.896213 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.896420 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.896622 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.896794 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.896967 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897123 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897251 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897388 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897515 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897642 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897781 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.897966 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898154 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898293 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898408 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898531 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898720 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.898919 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899087 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899219 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899353 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899479 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899613 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899739 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.899909 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900045 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900172 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900413 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900542 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.900675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.901446 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.901574 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.901713 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.901841 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.901841 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902081 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902220 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902347 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902472 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902705 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.902970 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.903309 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.903616 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.903875 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904008 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904217 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904358 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904606 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904791 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.904923 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905048 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905225 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905354 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905539 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905671 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.905894 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.906026 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.906212 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.906356 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.906583 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.906764 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.907093 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.907241 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.907370 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.908403 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.908571 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.908702 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.908702 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.908950 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.909840 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.909840 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910095 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910224 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910350 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910602 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910602 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910852 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.910988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911226 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911476 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911615 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911772 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.911926 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912054 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912177 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912302 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912437 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912570 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912712 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.912946 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913076 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913201 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913342 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913476 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913602 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913791 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.913921 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914105 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914237 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914457 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914588 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914776 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.914905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.915159 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.915291 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.915489 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.915618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.915891 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916059 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916202 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916329 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916529 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916670 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916846 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.916984 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917165 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917295 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917483 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917614 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917801 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.917940 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918129 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918258 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918446 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918583 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918767 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.918908 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.919085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.919215 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.919414 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.919544 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.919732 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.920077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.920389 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.920710 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.921072 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.921460 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.921823 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.922212 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.922443 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.922641 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.922793 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.923136 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.923273 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.923470 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.923719 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.924085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.924418 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.924743 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925019 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925158 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925363 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925493 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925691 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.925820 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926015 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926144 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926336 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926500 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926637 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926832 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.926973 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.927173 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.927301 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.927497 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.927627 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.927856 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.928057 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.928218 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.928571 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.928705 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.928908 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.929224 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.929355 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.929557 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.929815 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.929946 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.930195 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.930396 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.930526 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.930828 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.930992 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.931147 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.931479 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.931618 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.931973 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.932189 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.932319 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.932550 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.932679 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.932881 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933012 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933232 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933369 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933495 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933634 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933814 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.933943 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934158 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934488 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934624 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934803 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.934932 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935129 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935265 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935447 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935593 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935777 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.935906 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936108 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936236 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936426 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936641 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936771 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.936894 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937030 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937156 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937338 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937469 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937655 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937784 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.937971 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938105 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938285 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938414 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938599 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938725 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.938909 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.939044 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.939775 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.940419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.940419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.940689 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.940847 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941063 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941261 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941392 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941629 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941769 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.941903 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942045 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942347 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942494 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942664 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942664 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.942902 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.943287 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.943530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.943954 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.944089 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.944323 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.944660 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.944800 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.944991 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.945236 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.945607 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.945934 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.946261 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.946449 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.946591 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.946797 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.946934 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947132 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947262 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947495 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947636 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947857 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.947986 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948160 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948290 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948476 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948615 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948789 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.948919 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.949101 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.949229 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.949549 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.949687 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.949873 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.950107 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.950235 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.950518 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.950698 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.950835 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.951170 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.951309 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.951496 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.951845 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.951999 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.952169 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.952408 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.952546 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.952796 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.953023 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.953163 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.953596 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.953732 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.953964 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.954105 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.954667 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.954805 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.954995 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.954995 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.955245 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.955371 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.955507 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.955634 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.955795 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956036 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956164 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956377 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956522 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956733 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.956872 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957051 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957181 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957368 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957518 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957703 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.957834 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958019 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958149 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958333 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958472 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958647 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958778 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.958963 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959108 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959276 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959417 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959589 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959719 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.959940 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960070 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960256 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960400 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960569 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960699 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.960882 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.961012 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.961704 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.961852 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.961972 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962082 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962189 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962303 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962411 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962411 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.962704 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.963012 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.963366 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.963719 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.964024 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.964162 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.964385 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.964674 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.964791 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.965062 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.965219 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.965395 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.965709 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.966039 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.966363 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.966684 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.966897 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967028 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967155 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967317 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967506 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967636 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.967985 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968115 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968306 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968447 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968625 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968756 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.968940 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969076 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969259 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969389 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969571 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969710 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.969943 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.970103 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.970286 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.971170 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.971313 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.971491 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.971814 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.971954 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.972162 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.972411 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.972543 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.972784 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.972972 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.973112 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.973406 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.973570 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.973791 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974125 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974257 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974482 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974610 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974803 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.974942 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975126 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975256 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975445 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975574 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975772 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.975923 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976102 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976241 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976420 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976549 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976746 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.976885 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977065 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977195 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977380 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977510 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977691 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977822 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.977999 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978129 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978310 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978451 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978619 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978749 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.978937 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979067 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979248 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979386 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979573 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979711 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.979909 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980041 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980219 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980350 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980520 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980659 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980839 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.980968 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981154 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981283 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981461 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981595 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981858 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.981998 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.982124 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.982259 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.982386 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.982514 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.982719 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.983028 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.983352 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.983666 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.983937 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.984069 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987205 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987362 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987477 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987605 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987717 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987857 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.987857 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988075 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988075 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988075 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988075 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988491 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988597 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988702 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988823 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.988931 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989036 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989036 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989242 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989532 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989664 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989798 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.989927 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990052 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990185 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990321 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990449 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990575 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990701 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990827 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990960 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.990960 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.991217 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.991346 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.991552 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.991790 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.991961 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.992221 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.992353 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.992537 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.992852 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.992981 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.993165 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.993456 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.993596 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.993819 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.994040 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.994179 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.994633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.994764 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.994960 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.995090 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.995290 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.995554 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.995700 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.995908 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996041 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996233 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996363 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996552 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996684 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.996873 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997003 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997190 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997328 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997511 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997650 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997823 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.997962 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998134 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998264 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998463 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998588 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998782 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.998912 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999099 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999229 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999431 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999562 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999811 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:46.999946 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000212 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000393 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000525 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000717 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.000846 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001028 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001237 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001368 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001493 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001640 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001793 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.001981 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002126 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002337 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002466 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002592 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002717 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.002905 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.003045 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.003224 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.003412 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.003549 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.003682 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.004047 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.004364 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.004684 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.005082 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.005415 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.005607 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.005931 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.006071 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.006291 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.006477 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.006609 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.006959 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.007097 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.007382 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.007727 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.008091 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.008283 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.008413 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.008617 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.008750 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009028 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009157 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009361 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009505 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009695 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.009825 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010016 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010153 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010348 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010492 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010782 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.010912 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.011109 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.011361 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.011491 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.011734 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.011973 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.012089 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.012399 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.012581 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.012724 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.013043 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.013470 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.013792 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.014406 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.014550 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.014693 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.014931 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015070 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015206 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015354 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015560 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015691 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015848 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.015978 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016120 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016257 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016407 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016540 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016722 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.016870 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017054 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017194 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017391 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017525 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017723 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.017865 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018036 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018168 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018350 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018485 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018684 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.018830 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019000 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019174 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019315 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019493 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019632 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019834 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.019979 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020169 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020301 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020500 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020640 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020831 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.020962 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021142 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021275 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021460 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021600 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021776 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.021909 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022094 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022224 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022499 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022646 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022775 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.022901 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.023035 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.023368 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.023703 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.024137 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.024505 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.024837 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.025012 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.025183 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.025542 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.025681 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.025893 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.026115 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.026467 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.026795 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.027101 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.027234 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.027431 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.027570 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.027749 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028032 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028174 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028388 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028519 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028705 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.028834 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029022 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029153 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029336 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029474 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029650 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029781 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.029992 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.030131 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.030323 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.030641 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.030771 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.030959 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.031255 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.031396 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.031593 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.031875 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.032011 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.032255 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.032445 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.032591 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.032875 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.033558 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.033715 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034141 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034273 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034484 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034696 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034832 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.034967 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.035129 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.035294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.035461 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.035633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.035813 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036001 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036144 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036344 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036481 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036666 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.036796 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037003 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037143 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037331 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037460 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037644 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037771 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.037965 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038095 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038291 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038420 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038615 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038749 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.038941 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039071 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039265 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039394 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039581 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039715 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.039957 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040089 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040291 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040421 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040616 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040752 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.040943 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041189 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041319 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041527 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041656 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041850 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.041988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.042171 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.042302 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.042480 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.042622 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.042837 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.043115 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.043432 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.043797 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.044154 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.044544 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.044706 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.044897 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.045145 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.045275 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.045563 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.045719 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.046143 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.046502 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.046738 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.046869 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.047340 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.047480 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.047696 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.047849 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.048070 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.048209 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.048441 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.048612 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.049314 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.049456 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.049635 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.049766 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.049960 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050092 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050286 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050417 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050611 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050744 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.050951 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.051082 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.051307 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.051445 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.051642 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.051993 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.052148 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.052345 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.052583 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.052713 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.052996 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.053167 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.053309 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.053639 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.053770 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.053972 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.054300 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.054442 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.054752 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.054900 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.055099 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.055333 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.055464 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.055689 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.055841 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056052 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056168 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056498 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056613 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056749 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.056884 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.057041 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.057547 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.057677 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.057896 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058030 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058227 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058359 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058555 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058684 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.058883 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059026 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059210 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059341 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059535 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059671 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059874 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.059995 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060198 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060337 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060510 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060640 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060830 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.060961 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061147 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061278 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061459 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061599 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061788 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.061918 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062104 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062235 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062414 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062554 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062743 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.062874 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.063082 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.063221 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.063594 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.063976 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.064326 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.064612 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.064745 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.065068 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.065593 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.065732 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.065905 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.066103 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.066242 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.066580 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.066724 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.067020 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.067347 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.067682 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.067850 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068036 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068176 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068358 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068490 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068677 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.068956 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069096 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069297 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069427 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069610 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069739 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.069929 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070061 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070241 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070372 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070582 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070712 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.070913 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.071142 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.071274 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.071591 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.071723 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.071958 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.072287 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.072419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.072617 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.072881 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.073011 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.073454 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.073640 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.073772 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.074043 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.074173 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.074571 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.074699 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.074917 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075048 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075314 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075463 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075610 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075746 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.075930 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076060 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076235 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076366 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076554 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076694 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.076876 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077007 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077197 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077335 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077514 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077654 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077846 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.077979 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078168 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078298 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078485 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078624 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078811 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.078941 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.079126 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.079255 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.079458 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.079667 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.079837 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080076 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080201 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080404 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080543 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080740 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.080871 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081092 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081314 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081446 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081658 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081790 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.081986 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082120 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082305 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082434 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082751 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.082950 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.083334 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.083574 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.083938 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.084338 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.084664 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.084804 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.085032 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.085213 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.085368 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.085692 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.085826 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.086030 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.086281 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.086615 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.086945 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.087230 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.087362 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.087566 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.087698 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.087916 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088065 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088242 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088374 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088564 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088696 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.088885 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089017 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089210 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089340 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089562 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089693 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.089890 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.090021 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.090244 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.090459 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.090591 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.090868 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.091055 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.091187 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.091497 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.091655 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.091857 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.092148 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.092292 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.092466 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.092788 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.092917 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.093102 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.093443 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.093585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.093896 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094025 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094232 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094370 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094548 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094682 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094863 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.094994 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.095187 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.095319 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096091 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096232 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096390 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096570 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096714 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.096903 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097035 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097236 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097399 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097556 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097725 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.097888 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098226 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098329 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098541 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098654 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098872 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.098982 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.099189 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.099276 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.099525 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.099612 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.099899 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100006 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100215 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100319 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100532 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100640 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100859 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.100955 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101172 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101259 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101483 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101569 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101797 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.101885 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102114 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102203 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102428 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102522 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102810 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.102898 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.103127 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.103268 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.103521 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.103633 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.103900 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104073 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104226 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104360 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104508 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104654 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.104895 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.105040 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.105248 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.105441 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.105581 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.105927 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106067 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106298 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106440 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106580 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106727 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.106880 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107027 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107203 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107349 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107524 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107673 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.107945 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108039 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108263 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108354 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108579 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108676 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108892 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.108988 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109205 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109294 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109518 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109622 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109832 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.109920 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110188 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110277 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110513 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110651 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110843 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.110983 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.111214 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.111863 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112054 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112186 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112379 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112509 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112708 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.112845 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113022 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113155 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113342 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113479 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113660 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113774 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.113994 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114095 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114308 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114627 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114740 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.114947 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115055 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115263 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115360 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115570 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115677 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.115904 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116014 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116219 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116387 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116540 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116640 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116853 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.116942 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117163 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117252 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117469 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117566 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117781 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.117877 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118088 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118175 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118394 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118483 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118700 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.118788 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119005 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119101 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119316 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119423 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119620 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119707 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.119950 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120041 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120257 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120346 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120561 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120710 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.120865 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.121169 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.121264 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.121477 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.121780 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.121866 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122083 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122301 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122389 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122683 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122814 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.122990 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.123323 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.123419 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.123658 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124008 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124105 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124335 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124646 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124751 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.124969 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125282 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125370 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125605 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125865 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.125952 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.126234 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.126505 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.126604 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.126866 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.126958 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.127179 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.127267 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.127441 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 08:55:47.127529 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.127819 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.128136 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.128518 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.128748 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.129077 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.129405 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.129713 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.130038 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.130358 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.130683 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.131000 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.131312 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.131641 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.131976 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.132293 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.132607 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.132915 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.133226 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.133545 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.133863 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.134191 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.134517 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.134827 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.135153 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.135480 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.135855 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.136166 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.136514 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.136842 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.137155 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.137468 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.137779 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:55:47.138018 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 08:55:47.186064 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Registered counter for database nova_api Jun 03 08:55:47.195937 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Registered counter for database nova_api Jun 03 08:55:47.208252 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.215675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.216155 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.224107 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.272644 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.context [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d8a6cbe-b878-4842-b833-a44ee6ffbdfc(cell1) {{(pid=103342) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 08:55:47.276793 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 08:55:47.278366 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 08:55:47.279133 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 08:55:47.280740 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.context [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d8a6cbe-b878-4842-b833-a44ee6ffbdfc(cell1) {{(pid=103343) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 08:55:47.281139 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 08:55:47.283681 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Registered counter for database nova_cell0 Jun 03 08:55:47.285475 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 08:55:47.287072 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 08:55:47.287698 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Registered counter for database nova_cell1 Jun 03 08:55:47.287902 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 08:55:47.289879 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 08:55:47.291910 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Registered counter for database nova_cell0 Jun 03 08:55:47.295960 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.296133 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Registered counter for database nova_cell1 Jun 03 08:55:47.298077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.303640 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.304228 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.306458 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.310355 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.443520 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.451023 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.453421 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Registered counter for database nova_cell0 Jun 03 08:55:47.461728 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Registered counter for database nova_cell0 Jun 03 08:55:47.462889 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.467332 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.470399 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:55:47.475604 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:55:47.929589 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 08:55:47.931020 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 08:55:47.937006 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 08:55:47.938304 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 08:55:48.163804 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 08:55:48.169471 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 08:55:48.169807 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 08:55:48.175210 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d908f709c0 pid: 103343 (default app) Jun 03 08:55:48.175729 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-11080368-d2f2-4995-b00d-66f7b2b0f76a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 08:55:48.177562 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:55:48.178749 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 03 08:55:48.179166 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Fri Jun 3 08:55:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:55:48.181063 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d908f709c0 pid: 103342 (default app) Jun 03 08:57:10.627002 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:10.628118 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 03 08:57:10.628522 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:10.647486 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:10.648880 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:10.649997 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:10.651111 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:11.159338 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-d4416521-cf3d-4878-bc57-59fee2583b0d admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:11.190693 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-d4416521-cf3d-4878-bc57-59fee2583b0d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.554538 Jun 03 08:57:11.191674 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 08:57:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:13.526361 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:13.527350 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8eff926a-ac98-4225-ad34-493a6f46501f None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 03 08:57:13.527932 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:13.590509 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-cb1df8f8-13c2-4d9e-8b63-66d557d92d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:13.610204 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 08:57:13.610204 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 03 08:57:13.645028 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-cb1df8f8-13c2-4d9e-8b63-66d557d92d8f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110363 Jun 03 08:57:13.645778 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:13.863279 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9d072e34-2af4-429c-b684-8aad56c3364e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:13.865740 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 08:57:13.865740 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 08:57:13.868430 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:13.869233 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:13.870381 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:13.871069 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:13.931171 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9d072e34-2af4-429c-b684-8aad56c3364e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277498 Jun 03 08:57:13.931782 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 08:57:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:16.251563 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-cb1df8f8-13c2-4d9e-8b63-66d557d92d8f admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:16.253224 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-cb1df8f8-13c2-4d9e-8b63-66d557d92d8f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Jun 03 08:57:16.253777 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 08:57:16.369280 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-373951b6-0be6-4cb7-890c-467adff1dbc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "swap": 0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:16.386318 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 08:57:16.386318 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 08:57:16.404236 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-373951b6-0be6-4cb7-890c-467adff1dbc4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143930 Jun 03 08:57:16.404798 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:16.417051 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c317081e-6651-4089-86b8-5c4bef66a97d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:16.418620 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 08:57:16.418620 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 03 08:57:16.449858 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c317081e-6651-4089-86b8-5c4bef66a97d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036534 Jun 03 08:57:16.450836 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 08:57:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:18.779224 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-373951b6-0be6-4cb7-890c-467adff1dbc4 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:18.781444 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-373951b6-0be6-4cb7-890c-467adff1dbc4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Jun 03 08:57:18.782290 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:18.863332 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f7717561-364f-4e10-8cff-08a113649b7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:18.912444 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f7717561-364f-4e10-8cff-08a113649b7f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121055 Jun 03 08:57:18.913046 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 08:57:18.925354 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1c689c6e-61a6-4d6a-94d4-4a048548b593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:18.954394 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1c689c6e-61a6-4d6a-94d4-4a048548b593 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032969 Jun 03 08:57:18.955566 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 08:57:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:21.269447 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f7717561-364f-4e10-8cff-08a113649b7f admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:21.270376 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f7717561-364f-4e10-8cff-08a113649b7f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 03 08:57:21.270781 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:21.334835 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c0bdd6f3-9749-49d0-b92c-891baf5fd25a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:21.354041 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c0bdd6f3-9749-49d0-b92c-891baf5fd25a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076734 Jun 03 08:57:21.354859 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:21.366958 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-bc0c1c5a-ae83-47c1-be29-699b6e1a1f0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:21.392197 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-bc0c1c5a-ae83-47c1-be29-699b6e1a1f0b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028999 Jun 03 08:57:21.392822 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 08:57:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 08:57:23.700979 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c0bdd6f3-9749-49d0-b92c-891baf5fd25a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:23.701978 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c0bdd6f3-9749-49d0-b92c-891baf5fd25a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 03 08:57:23.702669 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:23.761422 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:23.778951 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070588 Jun 03 08:57:23.779676 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 08:57:23.791442 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-afe5ec19-c289-4a10-bd44-f4d6766e85c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:23.815745 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-afe5ec19-c289-4a10-bd44-f4d6766e85c6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027748 Jun 03 08:57:23.816350 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jun 3 08:57:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 08:57:26.145398 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:26.146417 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 03 08:57:26.146810 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 08:57:26.206743 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8d045a74-09c5-42cb-bc42-f6245f98a0f4 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:26.231621 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8d045a74-09c5-42cb-bc42-f6245f98a0f4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078855 Jun 03 08:57:26.232185 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 08:57:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:57:28.855458 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:28.856867 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-dbfa973b-1831-40bb-95fd-eeffb495b670 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jun 03 08:57:28.857351 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:28.922668 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-e1b1c289-e52e-49ce-8292-9bb1e7d8224a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 512, "disk": 1}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:28.943794 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-e1b1c289-e52e-49ce-8292-9bb1e7d8224a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079017 Jun 03 08:57:28.944375 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:28.959411 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a748f07d-5fc9-4ada-b06d-2b9fc8a7e85e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:28.986543 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a748f07d-5fc9-4ada-b06d-2b9fc8a7e85e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030953 Jun 03 08:57:28.987914 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 08:57:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:31.656706 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-e1b1c289-e52e-49ce-8292-9bb1e7d8224a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:31.657716 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-e1b1c289-e52e-49ce-8292-9bb1e7d8224a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 03 08:57:31.658190 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:31.721986 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-4d20fa99-d79b-4144-b31c-e5f031b65053 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:31.753715 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-4d20fa99-d79b-4144-b31c-e5f031b65053 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089472 Jun 03 08:57:31.754488 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:31.766895 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9a314a6f-3919-4778-8316-567a4dcad592 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:31.792972 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9a314a6f-3919-4778-8316-567a4dcad592 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029602 Jun 03 08:57:31.793723 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 08:57:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:34.153219 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-4d20fa99-d79b-4144-b31c-e5f031b65053 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:34.154231 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-4d20fa99-d79b-4144-b31c-e5f031b65053 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 03 08:57:34.154772 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 08:57:34.214745 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-513d3cca-bee5-4abf-83f7-1027a1af3c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:34.232179 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-513d3cca-bee5-4abf-83f7-1027a1af3c35 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071759 Jun 03 08:57:34.232732 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:34.244983 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f1f77b7b-485c-43d1-8e66-99935f21b268 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:34.269902 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f1f77b7b-485c-43d1-8e66-99935f21b268 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028561 Jun 03 08:57:34.279786 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 08:57:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:36.589770 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-513d3cca-bee5-4abf-83f7-1027a1af3c35 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:36.590767 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-513d3cca-bee5-4abf-83f7-1027a1af3c35 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 03 08:57:36.591178 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:36.650479 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-ae48f69a-7498-4236-95ee-e03164293bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:36.669356 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-ae48f69a-7498-4236-95ee-e03164293bfe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072042 Jun 03 08:57:36.670023 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:36.682168 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1d4c1d22-efe6-494c-858b-b27a1395081a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:36.708041 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1d4c1d22-efe6-494c-858b-b27a1395081a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029226 Jun 03 08:57:36.708864 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 08:57:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:57:39.061179 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-ae48f69a-7498-4236-95ee-e03164293bfe admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:57:39.062745 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-ae48f69a-7498-4236-95ee-e03164293bfe admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jun 03 08:57:39.063142 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:57:39.125040 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:39.146778 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077134 Jun 03 08:57:39.147414 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jun 3 08:57:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:57:39.160389 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f296820d-07b3-4bdb-8383-17e4295d770c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:57:39.184124 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f296820d-07b3-4bdb-8383-17e4295d770c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028484 Jun 03 08:57:39.184978 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jun 3 08:57:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:58:03.204714 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:03.205728 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 03 08:58:03.206120 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:03.217031 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:03.265555 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a7e31541-ee0f-4a93-a09b-3c1f45c59ff5 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:03.282115 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a7e31541-ee0f-4a93-a09b-3c1f45c59ff5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069967 Jun 03 08:58:03.282650 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 08:58:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 08:58:04.268783 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:04.269787 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-7a9606d6-421c-4913-bd0c-549a864638b5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 03 08:58:04.270180 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:04.464082 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3110a482-403d-43ca-8f1b-8ca8587d7a81 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:04.469772 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-3110a482-403d-43ca-8f1b-8ca8587d7a81 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3110a482-403d-43ca-8f1b-8ca8587d7a81 admin admin] Request method failure captured: Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Host: 10.222.0.61 Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABimc0cSQsvePM7UMKx2Nv2n-mC-bo-G12esplBo7lPztc6R9ZK7_ePv6EUrGIqo0I8W5WRSI9Kosea2DSUbzqj92CBN6-JJBoWEIjKNS5ddnIHzpQT25CGSNS3SejBlPUvVLEJ3PGkiFuaj-LGV0Sps_2yFkM4jFvIAtNR2iPvzxJBqzM Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Role: member,admin,reader Jun 03 08:58:04.473077 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Roles: member,admin,reader Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User: admin Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: method: > Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: exception: Flavor 42 could not be found. Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: action_args: {'id': '42'} Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:04.474500 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:04.475633 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.477050 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3110a482-403d-43ca-8f1b-8ca8587d7a81 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:04.478317 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3110a482-403d-43ca-8f1b-8ca8587d7a81 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062835 Jun 03 08:58:04.478317 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 08:58:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:04.484632 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-3e26eae6-b6ba-45bc-8d04-585f8f5d9151 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:04.487493 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:04.507188 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-3e26eae6-b6ba-45bc-8d04-585f8f5d9151 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026470 Jun 03 08:58:04.507661 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:04.519718 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-19121297-2aaa-48ec-a0e2-49fdece5a32c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:04.540431 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-19121297-2aaa-48ec-a0e2-49fdece5a32c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024245 Jun 03 08:58:04.540971 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:04.551948 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-d25ed5d6-80dc-4d7e-b2c5-437a08599987 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:04.558950 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-d25ed5d6-80dc-4d7e-b2c5-437a08599987 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-d25ed5d6-80dc-4d7e-b2c5-437a08599987 admin admin] Request method failure captured: Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Host: 10.222.0.61 Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABimc0cSQsvePM7UMKx2Nv2n-mC-bo-G12esplBo7lPztc6R9ZK7_ePv6EUrGIqo0I8W5WRSI9Kosea2DSUbzqj92CBN6-JJBoWEIjKNS5ddnIHzpQT25CGSNS3SejBlPUvVLEJ3PGkiFuaj-LGV0Sps_2yFkM4jFvIAtNR2iPvzxJBqzM Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Role: member,admin,reader Jun 03 08:58:04.562821 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Roles: member,admin,reader Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User: admin Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: method: > Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: exception: Flavor 42 could not be found. Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: action_args: {'id': '42'} Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:04.564344 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:04.565419 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:04.567199 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-d25ed5d6-80dc-4d7e-b2c5-437a08599987 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:04.568457 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-d25ed5d6-80dc-4d7e-b2c5-437a08599987 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016956 Jun 03 08:58:04.568457 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 08:58:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:05.431780 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-19121297-2aaa-48ec-a0e2-49fdece5a32c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:05.432806 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-19121297-2aaa-48ec-a0e2-49fdece5a32c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 03 08:58:05.433206 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:05.622264 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8c0dd4c2-c308-4807-94ca-4944f1be4396 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:05.628576 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-8c0dd4c2-c308-4807-94ca-4944f1be4396 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8c0dd4c2-c308-4807-94ca-4944f1be4396 admin admin] Request method failure captured: Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Host: 10.222.0.61 Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABimc0d-VKhkD_qrEo1ZNauyZo0LzLcI0m_oW03ZOQonAqKZdUBfSR4qopPrs9c_pQ4ZodKf3s7U-MMuLbttigmqOkoak7p1RlUe8NnB3e5sWFyv-1o9TBysgDHjdSKbKMH4GInveCJv67RJVpXIfT7fKdjaOxHMsI7wjWoVNjyELHhtrA Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Role: member,admin,reader Jun 03 08:58:05.630067 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Roles: member,admin,reader Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User: admin Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: method: > Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: exception: Flavor 84 could not be found. Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: action_args: {'id': '84'} Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:05.631585 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:05.633558 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.634618 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8c0dd4c2-c308-4807-94ca-4944f1be4396 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:05.635676 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8c0dd4c2-c308-4807-94ca-4944f1be4396 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060507 Jun 03 08:58:05.635676 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 08:58:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:05.641940 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-321945b6-9567-4da5-ba98-ddae40282f29 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:05.655456 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-321945b6-9567-4da5-ba98-ddae40282f29 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017819 Jun 03 08:58:05.656022 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:05.665304 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a5f0ebb4-d67c-4738-a941-ec267452937e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:05.679011 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a5f0ebb4-d67c-4738-a941-ec267452937e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017172 Jun 03 08:58:05.679569 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:05.689147 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1fa9fe73-3ab7-4da3-b18a-09550a3b78c2 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:05.694541 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-1fa9fe73-3ab7-4da3-b18a-09550a3b78c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1fa9fe73-3ab7-4da3-b18a-09550a3b78c2 admin admin] Request method failure captured: Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Host: 10.222.0.61 Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABimc0d-VKhkD_qrEo1ZNauyZo0LzLcI0m_oW03ZOQonAqKZdUBfSR4qopPrs9c_pQ4ZodKf3s7U-MMuLbttigmqOkoak7p1RlUe8NnB3e5sWFyv-1o9TBysgDHjdSKbKMH4GInveCJv67RJVpXIfT7fKdjaOxHMsI7wjWoVNjyELHhtrA Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Role: member,admin,reader Jun 03 08:58:05.696085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Roles: member,admin,reader Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User: admin Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: method: > Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: exception: Flavor 84 could not be found. Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: action_args: {'id': '84'} Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:05.697530 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:05.698407 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:05.699782 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1fa9fe73-3ab7-4da3-b18a-09550a3b78c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:05.701007 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-1fa9fe73-3ab7-4da3-b18a-09550a3b78c2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012321 Jun 03 08:58:05.701007 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jun 3 08:58:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:06.576639 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a5f0ebb4-d67c-4738-a941-ec267452937e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:06.577672 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a5f0ebb4-d67c-4738-a941-ec267452937e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 03 08:58:06.578065 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:06.768927 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7b6761c9-466b-49a7-b3b0-97b86b7cd3c1 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:06.774766 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-7b6761c9-466b-49a7-b3b0-97b86b7cd3c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7b6761c9-466b-49a7-b3b0-97b86b7cd3c1 admin admin] Request method failure captured: Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Host: 10.222.0.61 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABimc0e_iEGrwzifbktV7HEBW5ona1RsCGkEzo0Uid0911zRfr2IIb4L47KFz0-L-KzeqpHL30mHMcnJZmSgP05UIZxEGLfk-QDyTwopFR7kUkyR8lt1xhci_s2C61sHstweCAUeQ01UwcF9TuFsc6piaF-AyBWbQxIlvW5H4iT_TV06c8 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Role: member,admin,reader Jun 03 08:58:06.776294 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Roles: member,admin,reader Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User: admin Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: method: > Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: exception: Flavor 451 could not be found. Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: action_args: {'id': '451'} Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:06.778018 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:06.778905 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.780056 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7b6761c9-466b-49a7-b3b0-97b86b7cd3c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:06.781085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7b6761c9-466b-49a7-b3b0-97b86b7cd3c1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063405 Jun 03 08:58:06.781085 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 08:58:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:06.787406 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2304d7e8-c517-4c04-a8f2-f414cef75b2e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:06.801520 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-2304d7e8-c517-4c04-a8f2-f414cef75b2e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017643 Jun 03 08:58:06.802043 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:06.812039 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:06.825629 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017777 Jun 03 08:58:06.826159 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jun 3 08:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:58:06.835455 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-746d2cd9-e9f9-4489-9749-4bab74c2b843 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:06.840922 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-746d2cd9-e9f9-4489-9749-4bab74c2b843 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-746d2cd9-e9f9-4489-9749-4bab74c2b843 admin admin] Request method failure captured: Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Host: 10.222.0.61 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABimc0e_iEGrwzifbktV7HEBW5ona1RsCGkEzo0Uid0911zRfr2IIb4L47KFz0-L-KzeqpHL30mHMcnJZmSgP05UIZxEGLfk-QDyTwopFR7kUkyR8lt1xhci_s2C61sHstweCAUeQ01UwcF9TuFsc6piaF-AyBWbQxIlvW5H4iT_TV06c8 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Role: member,admin,reader Jun 03 08:58:06.842452 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Roles: member,admin,reader Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8d8a528e88945da98e9389d0fe7141f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Id: f8d8a528e88945da98e9389d0fe7141f Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User: admin Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Id: 85bd9af08cec4721bdd226bdaa9b2d35 Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: method: > Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: exception: Flavor 451 could not be found. Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: action_args: {'id': '451'} Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 08:58:06.844015 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:06.844980 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 03 08:58:06.846351 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-746d2cd9-e9f9-4489-9749-4bab74c2b843 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 08:58:06.847695 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-746d2cd9-e9f9-4489-9749-4bab74c2b843 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011987 Jun 03 08:58:06.847695 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 08:58:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:07.703799 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:07.704826 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jun 03 08:58:07.705226 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:07.895675 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5f23b2ae-e053-4930-abb4-221b3fde61b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:58:07.912612 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5f23b2ae-e053-4930-abb4-221b3fde61b8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069087 Jun 03 08:58:07.913147 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 08:58:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:58:08.789307 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:08.790323 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 03 08:58:08.790719 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:08.988371 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-dd24f30d-fb7b-4c24-9a28-4eda9baf76b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:58:09.005336 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-dd24f30d-fb7b-4c24-9a28-4eda9baf76b0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071470 Jun 03 08:58:09.005825 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 08:58:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:58:09.891178 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:09.892232 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 03 08:58:09.892638 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:10.082255 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c3206665-2ee4-4a24-9c52-0f90f3c916ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:58:10.100106 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c3206665-2ee4-4a24-9c52-0f90f3c916ce admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070208 Jun 03 08:58:10.100584 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 08:58:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:58:10.978409 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:10.979425 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 03 08:58:10.979925 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:11.176287 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-3ff82163-f4c1-41f5-8c6f-5b578371f169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 08:58:11.193253 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-3ff82163-f4c1-41f5-8c6f-5b578371f169 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071401 Jun 03 08:58:11.193784 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jun 3 08:58:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 08:58:12.057681 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:12.058680 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 03 08:58:12.059078 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 08:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:58:12.249540 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2990788d-5ab1-4e6a-ad33-930524d70b16 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:58:12.268424 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-2990788d-5ab1-4e6a-ad33-930524d70b16 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072826 Jun 03 08:58:12.268967 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Fri Jun 3 08:58:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 08:59:13.513686 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.514699 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b58e8c7f-9325-47a5-8870-dedcf283122c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 03 08:59:13.515145 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 08:59:13.522271 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:59:13.574836 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f8ef881c-2a99-4c5a-b2bf-be819c81027a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.593893 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f8ef881c-2a99-4c5a-b2bf-be819c81027a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072988 Jun 03 08:59:13.594440 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 08:59:13.615674 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=14 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:59:13.619380 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-22afba20-8e62-4160-9f04-c22a6964c115 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.627675 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-22afba20-8e62-4160-9f04-c22a6964c115 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013394 Jun 03 08:59:13.629201 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:59:13.640083 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a73fff37-cbad-4a08-87a0-362ed5d5b8f3 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.647911 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a73fff37-cbad-4a08-87a0-362ed5d5b8f3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011448 Jun 03 08:59:13.648432 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 08:59:13.659866 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.667609 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011268 Jun 03 08:59:13.668173 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 08:59:13.680168 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-0085b530-6f25-4beb-acd3-0de50ce49732 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 08:59:13.688404 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-0085b530-6f25-4beb-acd3-0de50ce49732 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011755 Jun 03 08:59:13.688925 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jun 3 08:59:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:02:29.774533 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:29.775603 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 03 09:02:29.776035 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 09:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:02:29.935667 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=6 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:30.049987 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:30.051247 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:02:30.051247 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 09:02:30.052502 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:30.053130 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:30.053851 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:30.054280 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:30.089043 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-4e84126a-dc03-4bd9-9d0b-b13b52598d94 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158329 Jun 03 09:02:30.089603 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 09:02:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:02:30.989558 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:30.990928 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 03 09:02:30.991025 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 09:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:02:31.178868 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:31.180076 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:02:31.180076 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 09:02:31.181275 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:31.181718 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:31.182506 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:31.182938 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:31.202002 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ee4bb5c9-9a00-4a5e-a330-83069349359f admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074643 Jun 03 09:02:31.202485 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 09:02:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:02:42.511360 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:42.512396 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 03 09:02:42.512792 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 09:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:02:42.654250 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:42.654982 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:42.655617 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=8 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:42.705681 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:42.706877 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:02:42.706877 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 09:02:42.708107 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:42.708556 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:42.709347 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:42.709781 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:42.734731 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a4180e48-bcf3-40ee-8593-4ad24f092643 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084809 Jun 03 09:02:42.735277 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 09:02:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:02:43.603796 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:43.604812 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f9f55ff2-2ca3-4909-8232-ccc107edab47 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 03 09:02:43.605496 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jun 3 09:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:02:43.796068 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:02:43.797841 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:02:43.797841 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 03 09:02:43.799072 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:43.799514 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:43.800334 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:02:43.800765 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:02:43.822045 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-84d562a8-7edf-4d4a-9c9a-72c7a4f7be5e admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077325 Jun 03 09:02:43.822540 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jun 3 09:02:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:03:44.147618 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: Fri Jun 3 09:03:44 2022 - graceful shutdown triggered... Jun 03 09:03:44.147401 dv-cinder-812685-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 09:03:44.148677 dv-cinder-812685-8-iscsi devstack@n-api.service[103342]: Gracefully killing worker 1 (pid: 103342)... Jun 03 09:03:44.149038 dv-cinder-812685-8-iscsi devstack@n-api.service[103343]: Gracefully killing worker 2 (pid: 103343)... Jun 03 09:03:45.148422 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: worker 1 buried after 1 seconds Jun 03 09:03:45.148422 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: worker 2 buried after 1 seconds Jun 03 09:03:45.148422 dv-cinder-812685-8-iscsi devstack@n-api.service[103341]: goodbye to uWSGI. Jun 03 09:03:45.149990 dv-cinder-812685-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 09:03:45.150561 dv-cinder-812685-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 09:03:45.153253 dv-cinder-812685-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 09:03:45.166857 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:03:45 2022] *** Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: nodename: dv-cinder-812685-8-iscsi Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: machine: x86_64 Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: clock source: unix Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: pcre jit disabled Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: detected number of CPU cores: 4 Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: current working directory: / Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: your processes number limit is 47680 Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: your memory page size is 4096 bytes Jun 03 09:03:45.186845 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: detected max file descriptor number: 2048 Jun 03 09:03:45.188014 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: lock engine: pthread robust mutexes Jun 03 09:03:45.188014 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: thunder lock: enabled Jun 03 09:03:45.188014 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 09:03:45.188014 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:03:45.232304 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: Python main interpreter initialized at 0x556e54c629c0 Jun 03 09:03:45.232304 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: python threads support enabled Jun 03 09:03:45.232304 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: your server socket listen backlog is limited to 100 connections Jun 03 09:03:45.232304 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:03:45.232720 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:03:45.232720 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: *** Operational MODE: preforking *** Jun 03 09:03:45.233017 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:03:45.233017 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: spawned uWSGI master process (pid: 117739) Jun 03 09:03:45.233237 dv-cinder-812685-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 09:03:45.233799 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: spawned uWSGI worker 1 (pid: 117753, cores: 1) Jun 03 09:03:45.234316 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: spawned uWSGI worker 2 (pid: 117754, cores: 1) Jun 03 09:03:45.236137 dv-cinder-812685-8-iscsi devstack@n-api.service[117739]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:03:46.487082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:03:46.487723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:03:47.321927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:03:47.321927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: from cryptography.utils import int_from_bytes Jun 03 09:03:47.322245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:03:47.322245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: from cryptography.utils import int_from_bytes Jun 03 09:03:47.322394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:03:47.322394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: from cryptography.utils import int_from_bytes Jun 03 09:03:47.322519 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:03:47.322519 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: from cryptography.utils import int_from_bytes Jun 03 09:03:49.752047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:03:49.752650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:03:49.752929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:03:49.753213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:03:49.753475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:03:49.753872 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.754205 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.754601 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.754855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.755237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.755564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.755915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.756246 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.756586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.756848 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.757172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.757503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-8-iscsi {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.757834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.758150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.758467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.758796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.759102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.759431 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.759745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.760280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.761839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.761839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.761839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.762200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.762496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.762620 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:03:49.763002 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.763084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:03:49.763167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.763372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:03:49.763494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.763791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:03:49.764030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.764268 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:03:49.764478 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.764689 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.764906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-8-iscsi {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.765133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.765370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.765594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.766430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.766678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.766926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.767151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.767436 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.767667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.767941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.768162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.768385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.768600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.768816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.769907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770065 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-8-iscsi {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770250 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770449 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770765 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.770935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771244 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771397 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771720 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.771911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772221 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772379 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.772860 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773354 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773508 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773663 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.773899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.774459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.774625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.774780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.774973 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.775385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.775559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.775704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.775926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776073 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776225 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.776982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.777264 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-8-iscsi {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.777432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.777587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.777739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.777898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.778945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779090 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779411 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779563 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779707 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.779895 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780064 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780506 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.780967 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781120 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781275 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781584 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.781891 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.782935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783079 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.783915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.784601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.784766 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.784919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.785078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.785239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.785648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.785801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.785957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.786867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.787946 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788690 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.788986 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789288 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.789882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790641 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.790948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.791884 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.792043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.792043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.792576 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.792733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.792884 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793349 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.793780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.794059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.794344 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.794894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.795052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.795213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.795359 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.795528 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796187 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796629 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796788 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.796940 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797541 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.797842 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798598 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798751 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.798895 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799654 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.799998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800298 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800605 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800749 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.800908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.801953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.802105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.802249 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.802402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.802553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.802705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.802865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.803019 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.803163 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.803314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.803470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.803621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.803785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.803947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.804099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.804253 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.804486 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.804998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.805159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.805315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.805459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.805613 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.805864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.806195 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.806349 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.806500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.806645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.806798 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.806942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.807085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.807227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.807381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.807534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.807688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.807899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.808060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.808205 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.808355 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.808512 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.808664 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.808816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.808960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.809111 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.809263 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.809431 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.809576 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.809729 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.809875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.810017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.810171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.810336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.810491 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.810491 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.810771 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.810916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.811060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.811215 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.811385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.811530 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.811673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.811848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.812014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.812275 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.812429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.813073 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:03:49.813297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.813457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.813602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.813755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.817495 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.817700 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.817874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818045 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818203 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818366 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.818974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.819169 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.819413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.819569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.819569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.819895 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820819 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.820974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821586 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.821887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822650 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.822896 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823210 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823354 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823498 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.823854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.824916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825223 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825665 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.825833 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.826486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.826763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827563 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.827918 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.828068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.828212 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.828897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.829960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830111 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.830908 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831223 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.831952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832129 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.832882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833186 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833349 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833813 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.833966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.834878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.835966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.836671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.836917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.837263 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.837418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.837563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.837707 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.837851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838778 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.838930 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839691 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.839912 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840376 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.840983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841134 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.841874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842338 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.842947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843241 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843701 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.843903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844222 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844566 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844718 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.844870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.845954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.846099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.846267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.846854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.847098 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.847275 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.847629 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.847801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.847971 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.848127 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.848280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.848424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849133 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849301 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849593 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849746 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.849892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850050 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.850950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.851095 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.851254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.851399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.851552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.851846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852300 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.852908 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.853139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.853310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.853488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.853824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.853993 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854139 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854729 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.854875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.855926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.856072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.856227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.856372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.856951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.857945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.858357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.858507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.858659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.858844 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.859872 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860041 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.860980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861752 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.861911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862214 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862374 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.862842 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.863983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.864145 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.864298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.864475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.864636 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.865385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.865559 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.865719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.865871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.865871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.866181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.866181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.866469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.866620 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.867202 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.867399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.867641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.867820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868652 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.868961 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869264 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.869591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870049 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870693 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.870845 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.871980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872297 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872760 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.872919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.873875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.874179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.874339 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.874545 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.874697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.874849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.875000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.875720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.875904 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876051 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.876817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.877381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.877542 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.877784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.877947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.878126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.878361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.878530 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.878800 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.878952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879118 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.879964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880831 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.880982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.881141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.881305 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.881922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882103 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.882890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883210 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.883889 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884356 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884834 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.884995 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.885947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886098 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886250 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886720 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.886873 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.887024 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.887607 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.887930 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.888303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.888303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.888748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889176 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.889966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.890117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.890277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.890442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.890604 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.890818 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.891467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.891635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.891935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.892891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.893043 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.893193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.893344 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.893504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.893677 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.894453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.894618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.894780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.894933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.894933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.895239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.895476 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.895632 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.895844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.896868 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.897020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.897173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.897810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.898086 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.898256 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.898417 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.898693 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.898873 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899320 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.899990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.900933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.901245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.901399 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.901558 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.901717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.901868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.902600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.902774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.902929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903090 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903245 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.903931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.904867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905027 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905186 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905508 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.905977 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.906137 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.906299 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.906491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.906643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.907030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.907204 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.907373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908302 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908376 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908456 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908863 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.908863 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909546 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909765 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909847 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.909999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910404 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.910998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911383 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911607 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911687 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911687 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.911980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912220 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.912927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913305 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913922 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.913999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914538 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914832 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.914989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915367 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915445 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915609 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.915939 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916452 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.916970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917805 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.917960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918199 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918354 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918588 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.918959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919179 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919250 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919691 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.919953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920389 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920609 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920690 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.920913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921754 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.921846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922667 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922761 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.922939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923100 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923322 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923476 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.923899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924098 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924513 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924694 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924778 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.924952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925510 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925597 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925724 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.925968 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926090 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926588 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926770 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.926942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927201 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927546 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927887 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.927977 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928061 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928145 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928423 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928694 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928879 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.928972 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929065 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929241 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929334 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929512 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.929961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.930905 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931034 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.931927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932055 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932270 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932617 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932794 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932880 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.932970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933061 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933583 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.933767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.934012 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.934673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.934997 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.935172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.935338 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.935498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.935679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.935863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936828 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.936983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.937137 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.937291 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.937459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.937676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.938336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.938494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.938648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.938802 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.938970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939133 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939603 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.939987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.940845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.941905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942290 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.942901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.943130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.943225 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.943458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.943560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.943778 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944176 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.944806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.945939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946647 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946863 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.946957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.947938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948245 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948760 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.948855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949264 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949738 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.949883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950535 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950707 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.950850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951026 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.951940 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952094 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952228 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952766 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.952909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.953044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.953234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.953857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954363 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954684 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.954821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955004 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.955910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956243 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956700 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.956878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957323 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957496 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957633 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.957957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958575 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.958888 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.959914 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960399 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960531 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.960949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.961084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.961263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.961422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.961639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.961776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962266 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.962854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963379 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.963851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964237 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964746 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.964876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965687 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.965808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966028 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966154 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.966957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967401 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967585 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.967930 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.968072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.968225 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.968462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.968600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.968782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.969456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.969669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.969816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970003 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970629 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.970948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971572 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.971968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972378 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972522 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972798 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.972938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973417 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.973874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974343 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.974881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975053 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975379 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975693 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.975911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976049 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976700 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.976873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977201 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.977969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.978141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.978407 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.978561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.978749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.978877 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979058 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.979869 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980157 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980632 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980771 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.980964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981272 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981580 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.981932 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982772 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.982914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983530 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.983885 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.984941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985409 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.985867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986495 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.986953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987408 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987709 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.987886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988215 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.988967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.989118 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.989272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.989983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990122 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990343 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990754 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.990894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991174 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991584 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991715 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.991960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992168 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992306 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992456 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.992875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993274 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.993876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994833 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.994970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995146 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995464 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995611 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.995951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996757 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.996894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997075 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997541 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.997835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998152 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.998955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999098 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999559 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:49.999893 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000547 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000686 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.000865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001012 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.001998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.002153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.002366 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.002496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.002643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.004808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.004976 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005259 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.005974 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006900 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.006900 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007159 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007301 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007994 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.007994 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008278 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.008934 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.009067 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.009198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.011348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.011519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.011519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.011820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.011958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012094 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012520 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.012870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013803 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.013803 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014621 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014621 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.014890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.015695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.016405 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.016540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.016672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.016672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.016672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017195 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017195 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.017919 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.018053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.018257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.018395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.018645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.018782 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.019079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.019246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.019418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.019772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.019928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.020096 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.020269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.020405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:03:50.020831 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.021166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.021487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.021890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.022210 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.022532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.022878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.023165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.023483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.023835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.024288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.024506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.024820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.025155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.025482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.025807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.026132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.026448 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.026790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.027105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.027422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.027744 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.028088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.028402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.028725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.029047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.029379 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.029712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.030034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.030370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.030717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.031057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.031436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.032304 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.032641 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.032964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.033283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.033598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:03:50.033842 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:03:50.080608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO dbcounter [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Registered counter for database nova_api Jun 03 09:03:50.093101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO dbcounter [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Registered counter for database nova_api Jun 03 09:03:50.101303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.107879 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writer thread running {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.113830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_db.sqlalchemy.engines [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.121393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writer thread running {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.168129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.context [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d8a6cbe-b878-4842-b833-a44ee6ffbdfc(cell1) {{(pid=117754) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:03:50.172455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:03:50.174081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:03:50.174893 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:03:50.176891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:03:50.178869 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO dbcounter [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Registered counter for database nova_cell0 Jun 03 09:03:50.179769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.context [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d8a6cbe-b878-4842-b833-a44ee6ffbdfc(cell1) {{(pid=117753) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:03:50.182906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO dbcounter [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Registered counter for database nova_cell1 Jun 03 09:03:50.183982 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:03:50.185668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:03:50.186481 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:03:50.188543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:03:50.190620 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO dbcounter [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Registered counter for database nova_cell0 Jun 03 09:03:50.191714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.192521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.194849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO dbcounter [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Registered counter for database nova_cell1 Jun 03 09:03:50.199197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writer thread running {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.200801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writer thread running {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.202162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_db.sqlalchemy.engines [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.204101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_db.sqlalchemy.engines [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.210774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writer thread running {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.212105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writer thread running {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.358550 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO dbcounter [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Registered counter for database nova_cell0 Jun 03 09:03:50.362490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO dbcounter [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Registered counter for database nova_cell0 Jun 03 09:03:50.365439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_db.sqlalchemy.engines [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.371537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_db.sqlalchemy.engines [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:03:50.371713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writer thread running {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.378483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writer thread running {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:03:50.842181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: WARNING keystonemiddleware.auth_token [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:03:50.843703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:03:50.849914 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: WARNING keystonemiddleware.auth_token [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:03:50.851944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:03:51.079995 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:03:51.086431 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: WARNING keystonemiddleware.auth_token [None req-e2309759-ed3c-49a5-b128-e7817320b6cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:03:51.091642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e54c629c0 pid: 117754 (default app) Jun 03 09:03:51.100229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: WARNING keystonemiddleware.auth_token [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:03:51.106442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: WARNING keystonemiddleware.auth_token [None req-89f1cff7-3509-4a11-a80b-3f43d1bd09b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:03:51.112312 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e54c629c0 pid: 117753 (default app) Jun 03 09:04:34.359725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.361661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.362630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.363583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.399449 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a9ebef6-b7cc-47c9-93cb-2863f1a174f9 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Action: 'create', calling method: .version_select at 0x7fd2b3338310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-185334507", "metadata": {"Type": "work"}}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:36.853648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cce6df7f-76fe-409f-ab7c-25361326c715 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b336bdc0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:36.890681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.892294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.894048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.895626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:38.374803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cce6df7f-76fe-409f-ab7c-25361326c715 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2aa96a3d-7351-48ac-a43d-7edf3a1bcf31" status: 200 len: 351 microversion: 2.1 time: 1.943214 Jun 03 09:04:38.375416 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:36 2022] GET /compute/v2.1/os-volumes/2aa96a3d-7351-48ac-a43d-7edf3a1bcf31 => generated 351 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:04:38.470760 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1393262545", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "networks": [{"uuid": "d9dd8370-eb21-4626-be26-44a0dc77d65d"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:38.730197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] validate_networks() for [('d9dd8370-eb21-4626-be26-44a0dc77d65d', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:04:38.737363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a9ebef6-b7cc-47c9-93cb-2863f1a174f9 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.384313 Jun 03 09:04:38.738962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 09:04:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 09:04:38.754978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7081bf66-f35c-4725-8d8d-9521990a484b tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Calling method '.version_select at 0x7fd2b31fd310>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:39.438611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7081bf66-f35c-4725-8d8d-9521990a484b tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c" status: 200 len: 353 microversion: 2.1 time: 0.691222 Jun 03 09:04:39.439658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:38 2022] GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c => generated 353 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:39.450586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8b14aa8d-b222-4903-90bc-54ede6b13faf tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Calling method '.version_select at 0x7fd2b31fd4c0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:39.726458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8b14aa8d-b222-4903-90bc-54ede6b13faf tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c" status: 200 len: 353 microversion: 2.1 time: 0.279656 Jun 03 09:04:39.727023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:39 2022] GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c => generated 353 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:04:40.072414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6712d20-ac16-4acd-9706-31262bf0c241 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: .version_select at 0x7fd2b31fd9d0>, body: {"keypair": {"name": "tempest-keypair-472059948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL699mxOp8QDdNu/PXRNWMoVKIITbUwSvScVwQpjND3YlP9nyu40v5oMUds5coFG6AuTF2od4VG5LngS+K2G6+ZnUVP8h5XSf2ACMJtMNhvS+k00g69SEJN/0dx4BwtM4g=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:40.152473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-d6712d20-ac16-4acd-9706-31262bf0c241 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for project 8e442ff861b14d6492a4b27899632a92. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:04:40.162636 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-d6712d20-ac16-4acd-9706-31262bf0c241 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for user 4a7b71aa00454406ab83a4891a8a719e and project 8e442ff861b14d6492a4b27899632a92. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:04:40.236926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6712d20-ac16-4acd-9706-31262bf0c241 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.508250 Jun 03 09:04:40.237990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 4/5] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:04:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:40.242836 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8601491a-9df1-46f5-b2ab-24bae33ae778 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Calling method '.version_select at 0x7fd2b3178280>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:40.358842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8601491a-9df1-46f5-b2ab-24bae33ae778 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c" status: 202 len: 0 microversion: 2.1 time: 0.119566 Jun 03 09:04:40.359720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 5/6] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:04:40 2022] DELETE /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:04:40.368685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32f5817f-9a43-45f5-b408-17ad9ad3a482 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Calling method '.version_select at 0x7fd2b3178f70>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:40.487618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-32f5817f-9a43-45f5-b408-17ad9ad3a482 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c" status: 200 len: 352 microversion: 2.1 time: 0.123172 Jun 03 09:04:40.488414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 6/7] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:40 2022] GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:40.731202 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-52900f8c-476b-4cbd-b766-3188f9848162 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b2927670>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:40.875132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-52900f8c-476b-4cbd-b766-3188f9848162 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/26ef388f-cec4-421d-b45d-d397c091c469" status: 200 len: 351 microversion: 2.1 time: 0.148264 Jun 03 09:04:40.876318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 7/8] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:40 2022] GET /compute/v2.1/os-volumes/26ef388f-cec4-421d-b45d-d397c091c469 => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:04:41.502737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89b84ad1-6b94-4e50-a794-816dc7729014 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Calling method '.version_select at 0x7fd2b3178d30>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:41.626838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-89b84ad1-6b94-4e50-a794-816dc7729014 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] HTTP exception thrown: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89b84ad1-6b94-4e50-a794-816dc7729014 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Request method failure captured: Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c HTTP/1.1 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6iHU834e1zEg32JSQAGpqvbRCe_O9rFHxbbhIgzEwYd735eRYfRemx9wfnTCUvuhb9acxh1fmWrOCuKHFp9lpzGMUX3dWV_bJLy7u-uX5xR0L6lx-7KFlbPVRQB6kk18KLC6GRH8flq8OBVeqjl1fO9hFq0tPfP3kXIZjXXqWWEUs Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 5a17189151294d619cfe62968c457c76 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesGetTestJSON-2041527461 Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:04:41.631925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a17189151294d619cfe62968c457c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a17189151294d619cfe62968c457c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a17189151294d619cfe62968c457c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a17189151294d619cfe62968c457c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesGetTestJSON-2041527461 Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 5a17189151294d619cfe62968c457c76 Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesGetTestJSON-2041527461 Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesGetTestJSON-2041527461-project Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 20f0b0b65d2243ef921c870ec24c745b Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesGetTestJSON-2041527461-project Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c'} Jun 03 09:04:41.633141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. (HTTP 404) (Request-ID: req-c9f5677d-bedd-497c-aecb-b4d7115254c1) Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:04:41.633989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:04:41.634923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:04:41.636128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. Jun 03 09:04:41.637327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:04:41.639418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89b84ad1-6b94-4e50-a794-816dc7729014 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] Returning 404 to user: Volume ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:04:41.641048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-89b84ad1-6b94-4e50-a794-816dc7729014 tempest-VolumesGetTestJSON-2041527461 tempest-VolumesGetTestJSON-2041527461-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c" status: 404 len: 109 microversion: 2.1 time: 0.144536 Jun 03 09:04:41.643743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 8/9] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:41 2022] GET /compute/v2.1/os-volumes/ed8b48e7-4b60-47b1-b68c-0ce2c72ed04c => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:04:41.948168 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:04:41.949387 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:04:41.950557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:04:41.951172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:04:41.952473 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:04:42.003320 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:42.003998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:42.005039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:42.005465 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:42.099538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Getting quotas for project f719985a98db414f873a2620b1ba980b. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:04:42.127371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Getting quotas for user 25fb4e59d5414fe9a2772469e9a956b5 and project f719985a98db414f873a2620b1ba980b. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:04:42.176779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:04:42.180355 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:04:42.456513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a0300558-5921-4ae1-b4fe-7fe9bcdd6d8e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.079807 Jun 03 09:04:42.458301 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 2/10] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:04:42.473605 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f1d9e9f-1243-4036-afd2-54be74ce0547 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:42.474938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f1d9e9f-1243-4036-afd2-54be74ce0547 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:42.812817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-15a5c87d-28a0-4f6e-9fc8-17b4bbdad764 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b310af70>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:42.817678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f1d9e9f-1243-4036-afd2-54be74ce0547 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:42.906159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f1d9e9f-1243-4036-afd2-54be74ce0547 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1215 microversion: 2.1 time: 0.441562 Jun 03 09:04:42.906746 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 9/11] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:42 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:04:42.964150 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-15a5c87d-28a0-4f6e-9fc8-17b4bbdad764 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/69c64669-e519-4328-8434-0e21a0a60e94" status: 200 len: 351 microversion: 2.1 time: 0.156184 Jun 03 09:04:42.965229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 3/12] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:04:42 2022] GET /compute/v2.1/os-volumes/69c64669-e519-4328-8434-0e21a0a60e94 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:04:42.976695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-37a31548-e1f1-4946-847f-cccedacf6444 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b28bfca0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.169731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-37a31548-e1f1-4946-847f-cccedacf6444 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.196850 Jun 03 09:04:43.170319 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 10/13] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jun 3 09:04:42 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:43.184467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bd49d467-83b8-4daf-b51c-afc11e0c5edf tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b28a2670>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.387744 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bd49d467-83b8-4daf-b51c-afc11e0c5edf tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.206968 Jun 03 09:04:43.388844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 4/14] 10.222.0.61 () {58 vars in 1148 bytes} [Fri Jun 3 09:04:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:43.400698 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d0cfb8db-30e7-4d79-8f63-ef312ed36889 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b290ef70>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.636475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d0cfb8db-30e7-4d79-8f63-ef312ed36889 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.239547 Jun 03 09:04:43.644688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 11/15] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jun 3 09:04:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:43.649229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d9d14c14-ed94-4c50-91d9-a03010a94089 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b28aa1f0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.911212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d9d14c14-ed94-4c50-91d9-a03010a94089 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.266302 Jun 03 09:04:43.912030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 5/16] 10.222.0.61 () {58 vars in 1166 bytes} [Fri Jun 3 09:04:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:43.932618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-af735177-9ef5-4ac6-adcf-7926a0c8dcb7 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b310aee0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.934731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9481035b-00c9-418e-a0bc-04450ed09caf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:43.937087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9481035b-00c9-418e-a0bc-04450ed09caf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:44.287004 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-af735177-9ef5-4ac6-adcf-7926a0c8dcb7 tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.362543 Jun 03 09:04:44.288108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 6/17] 10.222.0.61 () {58 vars in 1169 bytes} [Fri Jun 3 09:04:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:44.300145 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-711457ae-aa8d-4920-b3ef-dcf55871ac3f tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b28aa160>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:44.571469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9481035b-00c9-418e-a0bc-04450ed09caf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:44.583651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9481035b-00c9-418e-a0bc-04450ed09caf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1215 microversion: 2.1 time: 0.662875 Jun 03 09:04:44.597490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-711457ae-aa8d-4920-b3ef-dcf55871ac3f tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.301063 Jun 03 09:04:44.597862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 12/18] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:43 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1215 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:44.598125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 7/19] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jun 3 09:04:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:04:44.614612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b06d3e63-03e9-4193-bc90-2b7b594bc6cf tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b28c8a60>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:44.758034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2004112269", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f45126da-1a97-463c-b52c-80cba6e90689"}], "security_groups": [{"name": "tempest-securitygroup--1589954840"}], "key_name": "tempest-keypair-472059948", "user_data": "}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:44.903536 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b06d3e63-03e9-4193-bc90-2b7b594bc6cf tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.297839 Jun 03 09:04:44.904146 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 13/20] 10.222.0.61 () {58 vars in 1187 bytes} [Fri Jun 3 09:04:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:44.919171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f6710e8d-11a2-48d8-9cdb-8366e804b48f tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] Calling method '.version_select at 0x7fd2b3178280>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:45.198839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f6710e8d-11a2-48d8-9cdb-8366e804b48f tempest-VolumesTestJSON-253476232 tempest-VolumesTestJSON-253476232-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.284781 Jun 03 09:04:45.208422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] validate_networks() for [('f45126da-1a97-463c-b52c-80cba6e90689', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:04:45.211659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 14/21] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jun 3 09:04:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:45.605306 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:45.606307 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:45.644480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:45.645369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:45.648692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:45.650355 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:46.246998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:46.309977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9dc4e0df-a501-43a7-8e18-65432bcadea8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1267 microversion: 2.1 time: 0.711408 Jun 03 09:04:46.324254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 15/22] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:45 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1267 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:47.332482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:47.333211 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:47.347065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:47.347530 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:47.353037 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:47.353782 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:47.578137 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:47.585837 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a8c21deb-91ca-4449-b094-0a14aedc3825 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1273 microversion: 2.1 time: 0.261460 Jun 03 09:04:47.598935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 16/23] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:47 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:48.612960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:48.614297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:48.627882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:48.628585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:48.638136 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:48.639816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:48.719711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:04:48.720708 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:04:48.721434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:04:48.722165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:04:48.722968 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:04:48.763468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:48.767229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:48.769903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:48.789331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:48.854361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for project 8e442ff861b14d6492a4b27899632a92. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:04:48.863841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for user 4a7b71aa00454406ab83a4891a8a719e and project 8e442ff861b14d6492a4b27899632a92. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:04:48.892075 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:04:48.894890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:04:49.048193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-963610c2-a2c4-4b62-a6e2-4c1603515d94 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.295564 Jun 03 09:04:49.049361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 8/24] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:04:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 09:04:49.073425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1b7f9268-8ed2-45c2-816c-dd82dc31699b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:49.074600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1b7f9268-8ed2-45c2-816c-dd82dc31699b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:49.384469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1b7f9268-8ed2-45c2-816c-dd82dc31699b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:49.454837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1b7f9268-8ed2-45c2-816c-dd82dc31699b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1237 microversion: 2.1 time: 0.392876 Jun 03 09:04:49.455444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 9/25] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:49 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1237 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:49.498680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:49.511350 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f821645f-f4b2-46c1-9959-5384f8340da4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.908193 Jun 03 09:04:49.536144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 17/26] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:48 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:04:50.472921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6ded0336-9f65-4109-8075-7ca49c6c8ce4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:50.474364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6ded0336-9f65-4109-8075-7ca49c6c8ce4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:50.529019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:50.529659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:50.537576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:50.538073 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:50.538804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:50.539432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:51.049841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6ded0336-9f65-4109-8075-7ca49c6c8ce4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:51.065899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6ded0336-9f65-4109-8075-7ca49c6c8ce4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1237 microversion: 2.1 time: 0.596539 Jun 03 09:04:51.069922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 10/27] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:50 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1237 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:51.427646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:51.435164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3b3569f8-712a-4de4-b38b-c658bcc5df4d tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.909831 Jun 03 09:04:51.441650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 18/28] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:50 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:52.086768 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:52.087453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:52.102834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:52.109776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:52.112916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:52.127670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:52.187493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bd2ab386-5823-4de5-9113-ba7676e8cd5f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: .version_select at 0x7fd2b28be0d0>, body: {"keypair": {"name": "tempest-keypair-1552544705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6GJ6QNrFZynqCCcQ6KqdKeRfVBadiOz61xPMtFJrctYWAuz6dKb9+vi9jCWSQsMnCwni2Oi0dkVZO3cGrBBE86yfDNko3WJnwGeJDP3bYX8QMO9MQ3+EhwOGoUCqr/EQ=="}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:52.283665 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-bd2ab386-5823-4de5-9113-ba7676e8cd5f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for project fd9b906119034d8ea425a5b768b39e39. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:04:52.304208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-bd2ab386-5823-4de5-9113-ba7676e8cd5f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for user 22457f943fb84f0794695a132f93a3c3 and project fd9b906119034d8ea425a5b768b39e39. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:04:52.318391 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:52.332186 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-10a666e7-d4fd-4a84-9162-343caba7bc6b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1289 microversion: 2.1 time: 0.249957 Jun 03 09:04:52.332763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 19/29] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:52 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1289 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:04:52.410513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bd2ab386-5823-4de5-9113-ba7676e8cd5f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.597175 Jun 03 09:04:52.411460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 11/30] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jun 3 09:04:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 599 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 09:04:52.460164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:52.460793 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:52.477352 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:52.481937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:52.485477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:52.487417 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:53.220000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:53.228948 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-371de77f-194d-4785-8cf5-134bd46a554e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.774396 Jun 03 09:04:53.248201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 20/31] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:52 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:53.350209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:53.358101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:53.371229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:53.371689 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:53.372495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:53.388777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:54.157432 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:54.186245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e4f3fac8-ebb1-4e1b-b52c-63c8b32628e9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1295 microversion: 2.1 time: 0.840048 Jun 03 09:04:54.192115 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 12/32] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:53 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1295 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:54.251905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:54.253086 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:54.269637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:54.270132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:54.270913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:54.271357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:54.581742 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=8 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:54.978849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-94719e45-4beb-4679-8f8d-23537a771ed8 req-7b8a273b-96ae-4a0a-8655-1cc1ff10e440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5af49f-872b-460e-a7eb-289ab99ee9d2", "tag": "f0a4927d-bac4-4850-a9bd-71fa012b8b97"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:04:55.009504 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-94719e45-4beb-4679-8f8d-23537a771ed8 req-7b8a273b-96ae-4a0a-8655-1cc1ff10e440 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:55.010019 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-94719e45-4beb-4679-8f8d-23537a771ed8 req-7b8a273b-96ae-4a0a-8655-1cc1ff10e440 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:55.040206 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:55.066239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-94719e45-4beb-4679-8f8d-23537a771ed8 req-7b8a273b-96ae-4a0a-8655-1cc1ff10e440 service nova] Creating event network-changed:f0a4927d-bac4-4850-a9bd-71fa012b8b97 for instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 on hv-cinder-81268 Jun 03 09:04:55.066783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-94719e45-4beb-4679-8f8d-23537a771ed8 req-7b8a273b-96ae-4a0a-8655-1cc1ff10e440 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:04:55.068245 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c8df257-2362-4bdf-a460-a39ebc39aaf0 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.821979 Jun 03 09:04:55.083705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 21/33] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:54 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:55.090467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:55.091419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:55.093345 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:55.094022 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:55.106886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.compute.rpcapi [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:04:55.108916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:04:55.161740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-52dd0cd1-78c0-4c53-b869-01ca814b49e9 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.513663 Jun 03 09:04:55.162433 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 13/34] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:04:55.212164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:55.212970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:55.231369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:55.236470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:55.238982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:55.241983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:55.378502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:55.391168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af0e38bb-9688-4ede-9d30-d399f2ae58a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1295 microversion: 2.1 time: 0.186680 Jun 03 09:04:55.401554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 22/35] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:55 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:56.091839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:56.093488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:56.111987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:56.112843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:56.113845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:56.114513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:56.419035 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:56.421340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:56.435591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:56.456102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:56.457604 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:56.459920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:57.508580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:57.525303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0ed6f581-5d4f-4fda-983b-c9efd668c079 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1295 microversion: 2.1 time: 1.119336 Jun 03 09:04:57.568129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 23/36] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:56 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1295 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:57.653010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:57.673112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2983188d-aea5-4a6d-a055-e1b4195c8101 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 1.576024 Jun 03 09:04:57.676769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 14/37] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:56 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:58.584566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:58.585330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:58.603664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:58.606579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:58.607407 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:58.607925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:58.690784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:04:58.691394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:04:58.702334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:58.706190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:58.708446 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:04:58.716148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:04:59.736152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:59.776153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e3bb8976-0689-4481-bb56-4fc90ef74504 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 1.186666 Jun 03 09:04:59.777208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 24/38] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:58 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:04:59.938072 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:04:59.949987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0490a0a4-a2de-4799-8d2a-00a4e80bc99e tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 1.260708 Jun 03 09:04:59.952051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 15/39] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:04:58 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:00.796592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:00.797807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:00.816348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:00.816799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:00.817577 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:00.825989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:00.973540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:00.973540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:00.990470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:00.991269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:00.994090 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:00.994962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:01.282685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:01.300793 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a732bfb-5893-4145-9426-4d3ee988fc96 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.507894 Jun 03 09:05:01.306076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 25/40] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:00 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:01.327225 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-359470982", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9682f216-a94a-46fd-8ead-2a92b9dc4f42"}], "security_groups": [{"name": "tempest-securitygroup--544919967"}], "key_name": "tempest-keypair-1552544705", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:01.470881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:01.484108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-42e8790f-78c9-4c69-8dd8-ad2273a846a5 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.515157 Jun 03 09:05:01.484843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 16/41] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:00 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:01.512208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e09855d1-8dd2-4244-bd7e-4bf445a50a70 req-11a9fe98-ad44-4d38-a7e5-13e6af6c7ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66adb02f-314e-4e7b-bd15-d3a2674cfd38", "tag": "ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:01.538108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e09855d1-8dd2-4244-bd7e-4bf445a50a70 req-11a9fe98-ad44-4d38-a7e5-13e6af6c7ea6 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:01.538549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e09855d1-8dd2-4244-bd7e-4bf445a50a70 req-11a9fe98-ad44-4d38-a7e5-13e6af6c7ea6 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:01.567025 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e09855d1-8dd2-4244-bd7e-4bf445a50a70 req-11a9fe98-ad44-4d38-a7e5-13e6af6c7ea6 service nova] Creating event network-changed:ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2 for instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 on hv-cinder-81268 Jun 03 09:05:01.574785 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e09855d1-8dd2-4244-bd7e-4bf445a50a70 req-11a9fe98-ad44-4d38-a7e5-13e6af6c7ea6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078231 Jun 03 09:05:01.577882 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 17/42] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:01.619094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] validate_networks() for [('9682f216-a94a-46fd-8ead-2a92b9dc4f42', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:05:02.321759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:02.324079 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:02.334005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=20 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.336577 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:02.337245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:02.338366 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:02.339023 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:03.094185 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:03.139435 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3ba42c02-cdf6-401d-9276-1aa2794cba3d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.822633 Jun 03 09:05:03.156410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 18/43] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:02 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:03.165315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:03.166676 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:03.179108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:03.180366 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:03.182033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:03.183104 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:03.600699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:05:03.601688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:05:03.602337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:05:03.602896 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:05:03.603697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:05:03.623698 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:03.624204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:03.628816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:03.629713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:03.681068 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for project fd9b906119034d8ea425a5b768b39e39. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:05:03.687487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for user 22457f943fb84f0794695a132f93a3c3 and project fd9b906119034d8ea425a5b768b39e39. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:05:03.700821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:05:03.704313 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:05:03.760184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:03.769724 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b72a15ab-09e4-4f21-8399-89b6981600ef tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.611742 Jun 03 09:05:03.784260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 19/44] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:03 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:03.821421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ef479cd6-038b-4e8d-9862-19fdb5df7e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.514045 Jun 03 09:05:03.828891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 26/45] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jun 3 09:05:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 09:05:03.833244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:03.833845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:03.984763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:04.003630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:04.005740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:04.007091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3b2c45c7-9726-4829-920d-bb01ef0de665 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1281 microversion: 2.20 time: 0.178313 Jun 03 09:05:04.020189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 20/46] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:03 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1281 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:04.164940 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:04.165570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:04.176250 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:04.177112 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:04.178571 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:04.179093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:04.421294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:04.432047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f9675f07-aa37-4ab8-85b5-4d74e8748f2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.272325 Jun 03 09:05:04.433125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 27/47] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:04 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:04.796005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:04.797171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:04.824466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:04.827416 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:04.828498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:04.829144 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:05.036511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:05.039044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:05.055077 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:05.089539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:05.092203 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:05.093430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:05.095501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:05.097564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:05.097693 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d9c15aa2-2caa-4f4b-ac30-dd70464746ca tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.310870 Jun 03 09:05:05.098214 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 21/48] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:04 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:05.221540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:05.237247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:05.239421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:05.242068 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4a26a3f3-2b34-424c-9326-75093c35134e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.219478 Jun 03 09:05:05.243596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 28/49] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:05 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:05.449867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:05.450524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:05.453672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:05.459136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:05.459567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:05.460339 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:05.461038 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:05.609159 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:05.619364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-972c6c4b-dfb1-45f5-8430-3a4ca25a71b7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.173277 Jun 03 09:05:05.620131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 22/50] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:05 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:06.114251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:06.114874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:06.121655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.122034 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.122815 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.123294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.261626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:06.262424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:06.277209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.277566 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.279027 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.280319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.395560 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:06.395795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:06.403105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a86e77b6-0cec-4976-99c8-cb5af5dd0176 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.292629 Jun 03 09:05:06.403700 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 29/51] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:06 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:06.412050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:06.415053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:06.416651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-30545c3e-96c0-47a5-8173-90f247efd40d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.159503 Jun 03 09:05:06.418325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 23/52] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:06 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:05:06.637411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:06.638268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:06.645632 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.646092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.646860 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:06.647505 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:06.809668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:06.818920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7832b6d4-2e34-4696-a7b6-9529876b0fad tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.185528 Jun 03 09:05:06.819954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 30/53] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:06 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:07.422319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:07.423198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:07.444780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:07.445534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:07.447847 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.453164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.456473 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.456855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.457662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.458108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.461646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.461761 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=65 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.466126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.466801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.771183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:07.783501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:07.786588 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:07.787777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4991c705-efb2-49ba-aeb6-2216cb960726 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.348827 Jun 03 09:05:07.791982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 31/54] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:07 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:07.837067 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:07.837686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:07.840809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:07.844331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.844784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.845561 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:07.848684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:07.850140 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-95c0b7d3-c0ce-4a6c-81e2-c8b14e1b5b33 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.432781 Jun 03 09:05:07.861263 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 24/55] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:07 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:07.861682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:08.035108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:08.048017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ed67a47c-4dfc-4c59-bafd-6e309cff5bd1 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.214801 Jun 03 09:05:08.052208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 32/56] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:07 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:08.807846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:08.809246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:08.818802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:08.819346 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:08.820188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:08.820608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:08.868486 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:08.869883 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:08.877678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:08.878135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:08.879039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:08.884454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:08.890135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:08.900524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:08.901999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:08.903112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-86878fe0-0cce-40f8-a639-9d0c2c5a510b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.099964 Jun 03 09:05:08.903674 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 25/57] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:08 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:09.067973 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:09.068704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:09.075572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:09.077396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:09.080773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:09.083096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:09.132164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:09.149182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-05506611-7fff-4571-8cba-c95f5b8fbb1f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.284555 Jun 03 09:05:09.165153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 33/58] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:08 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:09.293199 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:09.304779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ca95fe3e-0f49-4cc4-8d5a-6c77c82c5518 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.240990 Jun 03 09:05:09.305931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 26/59] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:09 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:09.922614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:09.923278 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:09.929992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:09.930735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:09.931884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:09.932625 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:10.017505 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:10.027124 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:10.029611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:10.031038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d79c56de-a5d4-4d60-909a-07db894e81b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.113452 Jun 03 09:05:10.031830 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 34/60] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:09 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:10.177953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:10.178833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:10.188493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:10.188493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:10.189236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:10.189853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:10.322343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:10.322904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:10.339128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:10.341183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:10.342823 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:10.343936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:10.395538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:10.407486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b030d032-b404-4fa4-9199-692e39e6da11 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.234877 Jun 03 09:05:10.415206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 27/61] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:10 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:10.504981 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:10.515029 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-04e723b3-66a5-4515-bedc-eac0967f7982 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.196703 Jun 03 09:05:10.515659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 35/62] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:10 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:11.049956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:11.050961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:11.057077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.057749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.058906 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.059555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.134936 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:11.144156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:11.145671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:11.146937 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-71fcfced-a113-4223-8532-b6eb15616386 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1285 microversion: 2.20 time: 0.100840 Jun 03 09:05:11.157248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 28/63] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:11 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:11.426369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:11.427129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:11.437239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.438611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.443204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.444567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.535733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:11.537244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:11.552857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.553564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.554681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:11.555368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:11.980921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:11.989939 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2fa6d8f3-6197-4632-bccf-28f0222ed1cf tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.568328 Jun 03 09:05:11.999444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 36/64] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:11 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:12.025185 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:12.036048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5517c8ce-51a3-4b11-9f3f-f3848744964b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.506725 Jun 03 09:05:12.041510 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 29/65] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:11 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:12.165012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:12.165801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:12.180154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:12.180951 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:12.181968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:12.183620 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:12.353522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:12.385488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:12.389144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:12.390395 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7fc7b3bf-c558-4a3e-9f9c-76006102a905 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1333 microversion: 2.20 time: 0.229322 Jun 03 09:05:12.394732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 37/66] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:12 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:13.009424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:13.010150 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:13.017843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.018294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.019235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.019849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.059623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:13.060451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:13.070969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.072009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.076370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.076977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.325513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:13.342471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fc262554-1cae-4fba-abd3-b0d18a999008 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.339208 Jun 03 09:05:13.346822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 30/67] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:13 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:13.359875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:13.369495 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e736fd12-bcd7-477d-8748-86891eda1b9b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.315080 Jun 03 09:05:13.371152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 38/68] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:13 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:13.410194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:13.410931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:13.423026 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.423679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.424561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:13.425160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:13.554251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:13.569280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:13.572554 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:13.575209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-64f08586-7e3d-484d-82b2-ea100662d40a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1339 microversion: 2.20 time: 0.168425 Jun 03 09:05:13.586570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 31/69] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:13 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:14.368391 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:14.369100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:14.371313 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:14.372616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:14.378396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.378845 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:14.379608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.390445 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:14.390904 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:14.391640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:14.393840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:14.402532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.404731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:14.406352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.407020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:14.756410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:14.767566 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-00665ddb-adee-4a79-9ec7-7aa4c576d28a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.383991 Jun 03 09:05:14.768390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 32/70] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:14 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:14.798955 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:14.801165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:14.819222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:14.830028 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7559677-d6c3-47b2-bc74-b28638df2c19 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.468429 Jun 03 09:05:14.831197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 39/71] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:14 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:14.833061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.838474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:14.839327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:14.839813 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:15.022282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:15.032340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:15.033879 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:15.035006 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3f690712-8957-4053-bdfc-d6c28f49ee38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.265441 Jun 03 09:05:15.048124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 33/72] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:14 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:15.789138 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:15.791190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:15.806029 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:15.808417 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:15.810894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:15.814774 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:15.847483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:15.848276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:15.877190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:15.885266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:15.885266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:15.885266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:16.289825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:16.313818 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ccc7a058-c370-491b-a930-08718a2c8827 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.469617 Jun 03 09:05:16.318037 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 34/73] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:15 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:16.329679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:16.351734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec6a0c69-00ae-4d61-8ed3-237d81dd8b13 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.569875 Jun 03 09:05:16.365581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 40/74] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:15 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:16.366167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:16.366167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:16.387549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:16.389309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:16.390012 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:16.392364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:16.745784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:16.755832 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:16.759390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:16.761804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f031be86-d6aa-49cd-8d67-e30f1b8da4d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.440518 Jun 03 09:05:16.763857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 35/75] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:16 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:16.947464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-7481cedf-85dc-411a-b904-797fed67ef9f req-6e884427-cc74-49c3-bf35-7f30afb23e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:16.985297 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-7481cedf-85dc-411a-b904-797fed67ef9f req-6e884427-cc74-49c3-bf35-7f30afb23e2e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.001086 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-7481cedf-85dc-411a-b904-797fed67ef9f req-6e884427-cc74-49c3-bf35-7f30afb23e2e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.017581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-7481cedf-85dc-411a-b904-797fed67ef9f req-6e884427-cc74-49c3-bf35-7f30afb23e2e service nova] Creating event network-changed:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:05:17.026655 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-7481cedf-85dc-411a-b904-797fed67ef9f req-6e884427-cc74-49c3-bf35-7f30afb23e2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082943 Jun 03 09:05:17.028347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 36/76] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:17.049955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-83a87050-9df4-40c3-85dd-e9004e5464da req-71b89bb6-6422-4bc2-ac5d-4e77056b3054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5af49f-872b-460e-a7eb-289ab99ee9d2", "name": "network-vif-plugged", "status": "completed", "tag": "f0a4927d-bac4-4850-a9bd-71fa012b8b97"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:17.073829 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-83a87050-9df4-40c3-85dd-e9004e5464da req-71b89bb6-6422-4bc2-ac5d-4e77056b3054 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.074380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-83a87050-9df4-40c3-85dd-e9004e5464da req-71b89bb6-6422-4bc2-ac5d-4e77056b3054 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.106203 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-83a87050-9df4-40c3-85dd-e9004e5464da req-71b89bb6-6422-4bc2-ac5d-4e77056b3054 service nova] Creating event network-vif-plugged:f0a4927d-bac4-4850-a9bd-71fa012b8b97 for instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 on hv-cinder-81268 Jun 03 09:05:17.107093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-83a87050-9df4-40c3-85dd-e9004e5464da req-71b89bb6-6422-4bc2-ac5d-4e77056b3054 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:05:17.108682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.109438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.110466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.110890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.120573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.compute.rpcapi [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:05:17.121644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] Releasing lock "compute-rpcapi-router" {{(pid=117754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:05:17.149944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8b91b2d4-582f-4688-a540-8682a2485084 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.790448 Jun 03 09:05:17.152232 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 41/77] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:17.336207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:17.336919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:17.353126 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.353756 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.354713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.355299 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.377176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:17.377886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:17.395878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.396494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.397473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.399156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.723012 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:17.733565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bc94c7ed-85ae-4864-8799-eb998749f6b9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.403557 Jun 03 09:05:17.740408 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 37/78] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:17 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:17.782375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:17.783033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:17.783171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:17.795353 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-abe8723e-d782-40c8-b726-25fffd27e85e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.422669 Jun 03 09:05:17.796267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 42/79] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:17 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:17.804444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.804902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:17.805883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:17.806371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:18.144367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:18.156342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:18.165700 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:18.169099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1358a739-829b-4171-85d9-5978b10803f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.391187 Jun 03 09:05:18.170246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 38/80] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:17 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:05:18.757423 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:18.758040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:18.764781 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:18.765216 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:18.765970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:18.766740 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:18.817557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:18.818182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:18.827440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:18.828165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:18.828668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:18.829266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:19.093329 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:19.100976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7165d175-cff0-44ce-923e-fd86545946f6 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.347729 Jun 03 09:05:19.111261 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 43/81] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:18 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:19.117464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:19.130900 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2ce7596e-8f5c-4ef2-afde-61da789d25d2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.317399 Jun 03 09:05:19.132697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 39/82] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:18 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:19.187502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:19.188333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:19.197953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:19.198408 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:19.201270 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:19.201950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:19.386356 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:19.397183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:19.399342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:19.400547 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eec538fa-8e2b-4b6f-ae97-e28558ff6b5a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.217659 Jun 03 09:05:19.411891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 44/83] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:19 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:19.892005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-12c36f0e-986d-4fd0-b083-0feb03a95c72 req-492ef450-5585-479e-8899-5003726ee14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66adb02f-314e-4e7b-bd15-d3a2674cfd38", "name": "network-vif-plugged", "status": "completed", "tag": "ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:19.905928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-12c36f0e-986d-4fd0-b083-0feb03a95c72 req-492ef450-5585-479e-8899-5003726ee14f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:19.907034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-12c36f0e-986d-4fd0-b083-0feb03a95c72 req-492ef450-5585-479e-8899-5003726ee14f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:19.934846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-12c36f0e-986d-4fd0-b083-0feb03a95c72 req-492ef450-5585-479e-8899-5003726ee14f service nova] Creating event network-vif-plugged:ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2 for instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 on hv-cinder-81268 Jun 03 09:05:19.946276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-12c36f0e-986d-4fd0-b083-0feb03a95c72 req-492ef450-5585-479e-8899-5003726ee14f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057779 Jun 03 09:05:19.948368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 40/84] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:20.124084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:20.125156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:20.133306 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.135649 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.137743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.138411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.150540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:20.151499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:20.163489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.163984 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.164952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.165563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.467128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:20.475713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6bb5c68f-ffda-4693-b565-c5082bb1edf9 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.360352 Jun 03 09:05:20.480806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 45/85] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:20 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:20.485842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:20.490244 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:20.492243 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:20.501155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.501660 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.501904 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-72748190-ef4a-4d55-a3ae-0cf6235cf1f8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.357127 Jun 03 09:05:20.502669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 41/86] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:20 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:20.511517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:20.511517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:20.665791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:20.676233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:20.678287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:20.679819 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d537e7fe-6d61-4ee7-a916-ecf1727f64cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.197622 Jun 03 09:05:20.680561 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 46/87] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:20 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:21.494564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:21.495910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:21.502997 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.503534 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:21.504385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.504887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:21.508597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:21.519637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:21.520899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:21.528083 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.529308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:21.530303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.530887 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:21.763917 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:21.776859 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b779e793-3954-43fb-9a38-f327fb84900a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1315 microversion: 2.1 time: 0.285177 Jun 03 09:05:21.779428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:21.788420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-71f4997f-e9ae-4704-a426-45dd7b2f67ee tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.273171 Jun 03 09:05:21.789822 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 47/88] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:21 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:21.790637 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 42/89] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:21 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:21.796516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:21.797646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:21.805691 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.807048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:21.808154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:21.808783 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:22.038027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:22.049117 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:22.051014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:22.055909 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b08752b3-1da7-4189-ba39-ac527acbd693 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.261212 Jun 03 09:05:22.071118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 48/90] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:21 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:22.798309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:22.798931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:22.806777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:22.807960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:22.808701 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:22.809152 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:22.809964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:22.810403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:22.825311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:22.825812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:22.828573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:22.829052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:22.836311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:23.059256 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:23.067061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-24ffdb51-ddb0-4b85-9f36-40536cacf830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1503 microversion: 2.1 time: 0.274170 Jun 03 09:05:23.068489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 43/91] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:22 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:23.074011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:23.074790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:23.081803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:23.082573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:23.083486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:23.084092 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:23.092905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:23.102342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-44bdf9eb-d820-479a-835c-b52412ef8b29 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1363 microversion: 2.1 time: 0.299742 Jun 03 09:05:23.103166 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 49/92] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:22 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:23.429723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:23.441646 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:23.443435 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:23.445131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6b520d43-36e5-41eb-a2ad-46a0806a84a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.374744 Jun 03 09:05:23.446248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 44/93] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:23 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:05:23.836780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-93d9f91d-271d-441d-b9f9-5369c0a9c5c0 req-8e4d2476-d23b-462b-8f68-ea972a2801de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "name": "network-vif-plugged", "status": "completed", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:23.855258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-93d9f91d-271d-441d-b9f9-5369c0a9c5c0 req-8e4d2476-d23b-462b-8f68-ea972a2801de service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:23.858177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-93d9f91d-271d-441d-b9f9-5369c0a9c5c0 req-8e4d2476-d23b-462b-8f68-ea972a2801de service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:23.894351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-93d9f91d-271d-441d-b9f9-5369c0a9c5c0 req-8e4d2476-d23b-462b-8f68-ea972a2801de service nova] Creating event network-vif-plugged:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:05:23.912832 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-93d9f91d-271d-441d-b9f9-5369c0a9c5c0 req-8e4d2476-d23b-462b-8f68-ea972a2801de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079365 Jun 03 09:05:23.915282 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 50/94] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:24.120795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:24.122871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:24.131623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.132322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.133326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.134089 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.332400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:24.345166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1d83bb20-8b93-4ecd-a733-a2cd556679ea tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1548 microversion: 2.1 time: 0.229408 Jun 03 09:05:24.345747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 45/95] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:24 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:24.363337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:24.363945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:24.370545 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.371655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.371825 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.372204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.465261 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:24.465953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:24.480358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.481028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.484137 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.485007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.664296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-be2dd83b-18e1-4f00-b3b6-07af9259ad0e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.304992 Jun 03 09:05:24.665405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 51/96] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:05:24 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:24.788388 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:24.804590 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:24.811661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:24.812854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b454ce49-b7c5-4f1c-a1b8-6acea1f16bd4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1406 microversion: 2.20 time: 0.353328 Jun 03 09:05:24.813413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 46/97] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:24 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:05:24.834468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7010f5d4-3002-4ebe-9871-ebfdac96eeac"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:24.835616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:24.842480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.843117 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:24.848967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:24.851672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:25.399356 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-29c8ab55-cb26-4bd9-9183-6b71d0b59796 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "POST /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569519 Jun 03 09:05:25.400365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 52/98] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:05:24 2022] POST /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:25.832835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:25.833463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:25.841563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:25.841916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:25.843039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:25.843659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:26.003034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:26.011423 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:26.013670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:26.014958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7b1bd189-5690-46eb-ba96-eddcace1db42 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1597 microversion: 2.20 time: 0.188443 Jun 03 09:05:26.015713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 47/99] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:05:25 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1597 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:05:26.034914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:26.036154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:26.042905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:26.043363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:26.044201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:26.044639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:26.182595 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-6169dced-b3ae-4cb9-b540-da3097176c3c req-5bed2bc9-aec4-4932-8c73-84ef77c8bab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66adb02f-314e-4e7b-bd15-d3a2674cfd38", "tag": "ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:26.191718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-6169dced-b3ae-4cb9-b540-da3097176c3c req-5bed2bc9-aec4-4932-8c73-84ef77c8bab1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:26.192285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-6169dced-b3ae-4cb9-b540-da3097176c3c req-5bed2bc9-aec4-4932-8c73-84ef77c8bab1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:26.204818 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-6169dced-b3ae-4cb9-b540-da3097176c3c req-5bed2bc9-aec4-4932-8c73-84ef77c8bab1 service nova] Creating event network-changed:ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2 for instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 on hv-cinder-81268 Jun 03 09:05:26.210495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-6169dced-b3ae-4cb9-b540-da3097176c3c req-5bed2bc9-aec4-4932-8c73-84ef77c8bab1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031576 Jun 03 09:05:26.212010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 48/100] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:05:26.296807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fbe96cc9-a91a-46bc-a0a1-dc0e7ca801c3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.266794 Jun 03 09:05:26.297778 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 53/101] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jun 3 09:05:26 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-interface => generated 284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:05:26.536463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1930868333", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:26.624753 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] validate_networks() for None {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:05:27.826675 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:05:27.827332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:05:27.827557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:05:27.828169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:05:27.828738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:05:27.845739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:27.846224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:27.846987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:27.847428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:27.897658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Getting quotas for project e1843cdd14b54fd18d9c4623343ed5f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:05:27.905472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Getting quotas for user f3a1e4c97d634eb88e454f9e36424d45 and project e1843cdd14b54fd18d9c4623343ed5f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:05:27.922370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:05:27.925551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:05:28.004820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-65af6cd5-5935-4584-98c3-705de6df1a7a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472234 Jun 03 09:05:28.014543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:28.019304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2020d94e-ce3a-4c8d-863a-eb5601e58b46 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:28.019957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2020d94e-ce3a-4c8d-863a-eb5601e58b46 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:28.020691 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 49/102] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:05:28.155234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2020d94e-ce3a-4c8d-863a-eb5601e58b46 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:28.177784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2020d94e-ce3a-4c8d-863a-eb5601e58b46 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1215 microversion: 2.1 time: 0.164433 Jun 03 09:05:28.178384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 54/103] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:28 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:29.024404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ab3f1182-2ec5-4dd7-95dc-8829bd2f98f3 req-9f72bf36-04be-4f31-a073-331a02a81d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:29.034457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ab3f1182-2ec5-4dd7-95dc-8829bd2f98f3 req-9f72bf36-04be-4f31-a073-331a02a81d45 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:29.034909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ab3f1182-2ec5-4dd7-95dc-8829bd2f98f3 req-9f72bf36-04be-4f31-a073-331a02a81d45 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:29.046856 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ab3f1182-2ec5-4dd7-95dc-8829bd2f98f3 req-9f72bf36-04be-4f31-a073-331a02a81d45 service nova] Creating event network-changed:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:05:29.052293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ab3f1182-2ec5-4dd7-95dc-8829bd2f98f3 req-9f72bf36-04be-4f31-a073-331a02a81d45 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095067 Jun 03 09:05:29.056151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 50/104] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:29.194567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:29.195357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:29.202920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:29.203467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:29.204540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:29.204910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:29.266368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:29.274252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-540125a6-dab1-44a2-bb29-e278f8798f55 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1219 microversion: 2.1 time: 0.083601 Jun 03 09:05:29.274921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 55/105] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:29 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:30.293248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:30.294273 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:30.300546 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:30.300992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:30.301768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:30.302203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:30.369096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:30.377251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-acde341c-aa72-4a1b-a190-17889daa3979 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1211 microversion: 2.1 time: 0.088639 Jun 03 09:05:30.377827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 51/106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:30 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:31.395342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:31.396002 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:31.404184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:31.404629 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:31.405398 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:31.405827 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:31.472118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:31.482236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b7f747a3-f0b1-474b-ad0f-b7ac05cfec60 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1211 microversion: 2.1 time: 0.090599 Jun 03 09:05:31.483123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 56/107] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:31 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:32.499220 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:32.499794 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:32.505814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:32.506260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:32.507029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:32.507461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:32.569160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:32.576958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-099b4fd2-394a-4895-be79-9f29d6d629b0 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1275 microversion: 2.1 time: 0.081630 Jun 03 09:05:32.577535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 52/108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:32 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:33.594258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:33.595253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:33.602618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:33.603070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:33.604013 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:33.604469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:33.684045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:33.692570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b510eae9-a831-4e9b-b97b-eee813da9bda tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1275 microversion: 2.1 time: 0.102368 Jun 03 09:05:33.693149 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 57/109] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:33 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:34.709486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:34.710103 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:34.716282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:34.716729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:34.717501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:34.717939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:34.782962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:34.790471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4faff528-aa89-4fb2-ae86-c861efea31ea tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1275 microversion: 2.1 time: 0.084859 Jun 03 09:05:34.791303 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 53/110] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:34 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:35.807198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:35.807881 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:35.810504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=62 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:35.816792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:35.817242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:35.818033 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:35.818482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:35.886820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:35.894990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eaf84472-11eb-4aea-80e6-bc27aa0babc3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1275 microversion: 2.1 time: 0.091658 Jun 03 09:05:35.895578 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 58/111] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:35 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:36.912386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:36.912996 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:36.920106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:36.920499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:36.921264 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:36.921701 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:36.983949 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:36.992224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7027ea7f-83a6-468a-9a6a-611715c5742b tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1275 microversion: 2.1 time: 0.083629 Jun 03 09:05:36.992800 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 54/112] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:36 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:38.014024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:38.015127 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:38.044970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.046786 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:38.050864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.052423 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:38.170869 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:38.196727 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:38.206865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-00a07f1c-6dc8-41c1-ab92-4a4f09abb7bd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1273 microversion: 2.1 time: 0.199300 Jun 03 09:05:38.208929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 59/113] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:38 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:38.496524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:38.497161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:38.505471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:38.508212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:38.510292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:38.512260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.515881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:38.518489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.519467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:38.605604 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:05:38.818857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7d96a3b2-d453-41ee-86ca-743a3191286f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 204 len: 0 microversion: 2.1 time: 0.326582 Jun 03 09:05:38.819971 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 55/114] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:05:38 2022] DELETE /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:05:38.831508 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:38.832586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:38.843256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.844527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:38.845521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:38.847114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:39.068789 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:39.084450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-daac59ca-5b2b-4843-aa8c-153e716ab6b4 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1555 microversion: 2.1 time: 0.259498 Jun 03 09:05:39.085092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 60/115] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:38 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:39.227929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:39.229016 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:39.256808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:39.257632 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:39.259394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:39.260084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:39.384741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:39.394181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-779eb086-9a90-4067-94c0-4cb92ba73a6e tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1273 microversion: 2.1 time: 0.172047 Jun 03 09:05:39.394799 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 56/116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:39 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:40.106055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:40.107815 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:40.119743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:40.120603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:40.122064 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:40.122865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:40.371708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:40.381609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-407c89c0-4d8e-417b-b719-3593fb253edc tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1555 microversion: 2.1 time: 0.283031 Jun 03 09:05:40.392436 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 61/117] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:40 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:40.412616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:40.414068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:40.426556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:40.426556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:40.428406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:40.428891 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:40.719894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:40.746482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ffee6c88-0b54-44e0-88b1-0b99510e5f35 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.337804 Jun 03 09:05:40.751587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 57/118] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:40 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:41.399962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:41.400824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:41.413887 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:41.414675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:41.415816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:41.418167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:41.456390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e19b3aa3-fee9-4c21-a26d-6ce4974747ed req-f3216e7c-fb05-4424-8179-585734d8b541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d75dd0-6059-4062-8163-976091600985", "tag": "861ca9a1-52cb-48ea-beb0-1573ba1b123c"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:41.473770 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e19b3aa3-fee9-4c21-a26d-6ce4974747ed req-f3216e7c-fb05-4424-8179-585734d8b541 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:41.475627 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e19b3aa3-fee9-4c21-a26d-6ce4974747ed req-f3216e7c-fb05-4424-8179-585734d8b541 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:41.508587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e19b3aa3-fee9-4c21-a26d-6ce4974747ed req-f3216e7c-fb05-4424-8179-585734d8b541 service nova] Creating event network-changed:861ca9a1-52cb-48ea-beb0-1573ba1b123c for instance e4d75dd0-6059-4062-8163-976091600985 on hv-cinder-81268 Jun 03 09:05:41.524393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e19b3aa3-fee9-4c21-a26d-6ce4974747ed req-f3216e7c-fb05-4424-8179-585734d8b541 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068422 Jun 03 09:05:41.525587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 58/119] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:05:41.769852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:41.771950 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:41.797475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:41.802198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:41.804178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:41.805070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:41.953610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:41.977839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3b785cf-7d5e-42df-b739-aa1f18fd6642 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1555 microversion: 2.1 time: 0.581911 Jun 03 09:05:41.979894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:41 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1555 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:42.218657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:42.221488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:42.230830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0a92221a-1a46-487d-b152-d30ac474a2bb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.465529 Jun 03 09:05:42.231466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 59/121] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:41 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:42.642371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-191e175f-30fa-4c43-b627-252675837131 req-6eded957-466f-43ab-9fe0-790b90b77588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5af49f-872b-460e-a7eb-289ab99ee9d2", "name": "network-vif-deleted", "tag": "f0a4927d-bac4-4850-a9bd-71fa012b8b97"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:42.652043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-191e175f-30fa-4c43-b627-252675837131 req-6eded957-466f-43ab-9fe0-790b90b77588 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:42.652497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-191e175f-30fa-4c43-b627-252675837131 req-6eded957-466f-43ab-9fe0-790b90b77588 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:42.664580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-191e175f-30fa-4c43-b627-252675837131 req-6eded957-466f-43ab-9fe0-790b90b77588 service nova] Creating event network-vif-deleted:f0a4927d-bac4-4850-a9bd-71fa012b8b97 for instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 on hv-cinder-81268 Jun 03 09:05:42.673175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-191e175f-30fa-4c43-b627-252675837131 req-6eded957-466f-43ab-9fe0-790b90b77588 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034264 Jun 03 09:05:42.673890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 63/122] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:05:43.000388 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:43.001437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:43.014478 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:43.015442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:43.016963 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:43.017556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:43.105493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:43.114576 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d5eb85dc-e0e2-4fc0-862d-d4ec486fbb54 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1513 microversion: 2.1 time: 0.122002 Jun 03 09:05:43.115163 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 60/123] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:42 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1513 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:43.247739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:43.248476 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:43.255130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:43.255580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:43.256380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:43.256816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:43.699287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:43.709527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-645b0793-072a-4421-8c0b-bb57cf51bc3d tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.466017 Jun 03 09:05:43.710132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 64/124] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:43 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:44.132553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:44.134049 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:44.145718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:44.146634 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:44.147452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:44.148948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:44.289413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:44.302058 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a27f4f36-c468-4a76-af16-5fda8123ce82 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1513 microversion: 2.1 time: 0.174284 Jun 03 09:05:44.310688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 61/125] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:44 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:44.727377 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:44.728018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:44.736044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:44.736559 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:44.737539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:44.738049 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:44.943023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:44.951892 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d2b36132-59d3-4217-9dc3-c8051f8313de tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.228140 Jun 03 09:05:44.961676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 65/126] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:44 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:45.326772 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:45.328647 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:45.340348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:45.345870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:45.347141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:45.348363 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:45.449050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:45.459386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf9158fa-8f9b-4b71-a250-55134bb5d28a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1346 microversion: 2.1 time: 0.141167 Jun 03 09:05:45.459719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 62/127] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:45 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:45.978192 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:45.979089 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:45.988612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:45.989074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:45.989915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:45.990411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:46.155733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:46.166546 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f5cd0171-ea83-4665-9cdc-8c55991c36dd tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.199408 Jun 03 09:05:46.168479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 66/128] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:45 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:46.480896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:46.482224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:46.506928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:46.519593 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:46.520644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:46.521238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:46.624522 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:46.633810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8e29380f-c800-4594-96c7-82ef2a353830 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1346 microversion: 2.1 time: 0.159494 Jun 03 09:05:46.635021 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 63/129] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:46 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:47.186091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:47.186912 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:47.197965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:47.198950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:47.200551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:47.201659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:47.243544 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:47.416515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:47.424970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a4c708d3-0ad9-49dc-ab3a-19cb575e73a3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.244224 Jun 03 09:05:47.425792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 67/130] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:47 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:47.666330 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:47.667537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:47.674621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:47.675057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:47.676053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:47.676487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:47.754392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:47.770532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6ec57328-3dc2-4503-b3d9-10475acf40b8 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1346 microversion: 2.1 time: 0.107977 Jun 03 09:05:47.784309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 64/131] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:47 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:48.442243 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:48.442867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:48.449978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:48.450421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:48.451202 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:48.451634 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:48.675226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:48.688809 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4588ee4f-3029-4a77-96ef-3a0fbc47b8cb tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.250555 Jun 03 09:05:48.689502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 68/132] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:48 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:48.791684 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:48.792444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:48.800532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:48.801109 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:48.802034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:48.802403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:48.878954 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fb4e59d5414fe9a2772469e9a956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f719985a98db414f873a2620b1ba980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:48.887391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fcb8c617-cc83-4dd2-bc9e-57b47637308a tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 200 len: 1346 microversion: 2.1 time: 0.100457 Jun 03 09:05:48.888216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 65/133] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:48 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:49.713184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:49.713831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:49.721134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:49.721650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:49.722421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:49.722851 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:49.878507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:49.894152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-effeb264-c318-41a9-b62a-f676da2fbfb3 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.184512 Jun 03 09:05:49.895144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 69/134] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:49 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:49.904769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:49.905474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:49.914259 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:49.914771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:49.915796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:49.916225 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:49.932683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] HTTP exception thrown: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Request method failure captured: Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 HTTP/1.1 Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6lzjCf5Q2zjMxKK8W32-dMWYHlkoN1kusPWIbqC26FWkDN60FOvxdqGijGMljSTZqo0C4i-GJzuxxTT4TKPd-nZeZPqzOX7rkxayLt4de1fRa45pN_iEttmrNgtxHV62gwTPVrYLE2dWrHFwd5rtobGMfq10u-503b7NO2YypxwCo Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:05:49.938254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f719985a98db414f873a2620b1ba980b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f719985a98db414f873a2620b1ba980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 25fb4e59d5414fe9a2772469e9a956b5 Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:49.939683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '8b5af49f-872b-460e-a7eb-289ab99ee9d2'} Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:05:49.940529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:49.941621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:05:49.942581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Returning 404 to user: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:05:49.942581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-32110a99-d5d9-435e-a84b-ac17bb427702 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 404 len: 111 microversion: 2.1 time: 0.039172 Jun 03 09:05:49.942581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 66/135] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:49 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:05:50.048735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:50.049667 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:50.060401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:50.061339 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:50.062761 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:50.063613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:50.085217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] HTTP exception thrown: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Request method failure captured: Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2/os-volume_attachments HTTP/1.1 Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6lzjCf5Q2zjMxKK8W32-dMWYHlkoN1kusPWIbqC26FWkDN60FOvxdqGijGMljSTZqo0C4i-GJzuxxTT4TKPd-nZeZPqzOX7rkxayLt4de1fRa45pN_iEttmrNgtxHV62gwTPVrYLE2dWrHFwd5rtobGMfq10u-503b7NO2YypxwCo Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:05:50.089537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f719985a98db414f873a2620b1ba980b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f719985a98db414f873a2620b1ba980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 25fb4e59d5414fe9a2772469e9a956b5 Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:50.091015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'server_id': '8b5af49f-872b-460e-a7eb-289ab99ee9d2'} Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:05:50.091838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:50.092901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:50.094501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Returning 404 to user: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:05:50.094501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-17a9ba87-06d2-48b0-bf59-6ddc673e1195 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046439 Jun 03 09:05:50.094501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 70/136] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:05:50 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:05:50.914747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:50.915959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:50.923779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:50.924573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:50.925741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:50.926451 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.077842 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:51.085565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dd2868c9-7063-43d3-af5a-9eb01ae6a86a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.178081 Jun 03 09:05:51.086452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 67/137] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:50 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:51.322631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:51.324126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:51.332118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:51.332579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.333362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:51.333795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.349365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] HTTP exception thrown: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Request method failure captured: Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 HTTP/1.1 Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6lzjCf5Q2zjMxKK8W32-dMWYHlkoN1kusPWIbqC26FWkDN60FOvxdqGijGMljSTZqo0C4i-GJzuxxTT4TKPd-nZeZPqzOX7rkxayLt4de1fRa45pN_iEttmrNgtxHV62gwTPVrYLE2dWrHFwd5rtobGMfq10u-503b7NO2YypxwCo Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:05:51.351463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f719985a98db414f873a2620b1ba980b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f719985a98db414f873a2620b1ba980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 25fb4e59d5414fe9a2772469e9a956b5 Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.353849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '8b5af49f-872b-460e-a7eb-289ab99ee9d2'} Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:05:51.355119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.357541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.359776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Returning 404 to user: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:05:51.359776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-251f8873-8e22-449f-b620-6e5c9d0a4d9f tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 404 len: 111 microversion: 2.1 time: 0.034409 Jun 03 09:05:51.359776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 71/138] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:05:51 2022] DELETE /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:05:51.360137 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-66102a3c-6bef-4ad9-92b8-099ddd0c26e4 req-fc11b65f-4eb3-4b22-86da-a3898b4b06e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d75dd0-6059-4062-8163-976091600985", "name": "network-vif-plugged", "status": "completed", "tag": "861ca9a1-52cb-48ea-beb0-1573ba1b123c"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:05:51.367852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:51.368416 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-66102a3c-6bef-4ad9-92b8-099ddd0c26e4 req-fc11b65f-4eb3-4b22-86da-a3898b4b06e8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:51.368831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] [instance: 8b5af49f-872b-460e-a7eb-289ab99ee9d2] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:51.369139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-66102a3c-6bef-4ad9-92b8-099ddd0c26e4 req-fc11b65f-4eb3-4b22-86da-a3898b4b06e8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.379912 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:51.380706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.381814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-66102a3c-6bef-4ad9-92b8-099ddd0c26e4 req-fc11b65f-4eb3-4b22-86da-a3898b4b06e8 service nova] Creating event network-vif-plugged:861ca9a1-52cb-48ea-beb0-1573ba1b123c for instance e4d75dd0-6059-4062-8163-976091600985 on hv-cinder-81268 Jun 03 09:05:51.382732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:51.383471 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:51.396010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-66102a3c-6bef-4ad9-92b8-099ddd0c26e4 req-fc11b65f-4eb3-4b22-86da-a3898b4b06e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038846 Jun 03 09:05:51.396737 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 68/139] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:05:51.402591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] HTTP exception thrown: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Request method failure captured: Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 HTTP/1.1 Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6lzjCf5Q2zjMxKK8W32-dMWYHlkoN1kusPWIbqC26FWkDN60FOvxdqGijGMljSTZqo0C4i-GJzuxxTT4TKPd-nZeZPqzOX7rkxayLt4de1fRa45pN_iEttmrNgtxHV62gwTPVrYLE2dWrHFwd5rtobGMfq10u-503b7NO2YypxwCo Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:05:51.404114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f719985a98db414f873a2620b1ba980b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f719985a98db414f873a2620b1ba980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f719985a98db414f873a2620b1ba980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: f719985a98db414f873a2620b1ba980b Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-DeleteServersTestJSON-633770912 Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 25fb4e59d5414fe9a2772469e9a956b5 Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-DeleteServersTestJSON-633770912-project Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.407429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '8b5af49f-872b-460e-a7eb-289ab99ee9d2'} Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:05:51.408237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. Jun 03 09:05:51.409254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:05:51.410201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] Returning 404 to user: Instance 8b5af49f-872b-460e-a7eb-289ab99ee9d2 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:05:51.410201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4f796e50-895c-4fbd-b12d-66d0e04e6447 tempest-DeleteServersTestJSON-633770912 tempest-DeleteServersTestJSON-633770912-project] 10.222.0.61 "GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2" status: 404 len: 111 microversion: 2.1 time: 0.043628 Jun 03 09:05:51.410201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 72/140] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:51 2022] GET /compute/v2.1/servers/8b5af49f-872b-460e-a7eb-289ab99ee9d2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:05:52.103728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:52.104461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:52.111540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:52.112021 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:52.117030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:52.117030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:52.292535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:52.305779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-edf16ae8-abbc-43f0-82ea-faa6cdcf14b4 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.205986 Jun 03 09:05:52.307260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 69/141] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:52 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:53.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:53.334582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:53.345456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:53.346104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:53.347026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:53.347687 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:53.525773 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:53.534646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eeac37ef-ee42-4efe-9b8d-e065ec0c1927 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.207619 Jun 03 09:05:53.535042 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 73/142] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:53 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:54.556746 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:54.557783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:54.568353 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:54.568812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:54.569820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:54.570271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:54.752096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:54.761146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf950025-d6f6-408c-8581-1e10c77fb7b1 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.212083 Jun 03 09:05:54.762182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 70/143] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:54 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:55.779670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:55.780347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:55.787741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:55.788526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:55.789540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:55.790157 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:55.986552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:55.997137 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c03e871-832e-49a3-b365-fe349a7c6aad tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.220875 Jun 03 09:05:55.998389 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 74/144] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:55 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:05:57.019188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:57.020616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:57.029868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:57.030530 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:57.031893 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:57.032536 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:57.327854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:57.362639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a3580617-368a-435c-ba6d-9271dd8ad32a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1315 microversion: 2.1 time: 0.347196 Jun 03 09:05:57.363395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 71/145] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:57 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:58.381753 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:58.382673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:58.395618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:58.397654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:58.401046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:58.401651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:58.790110 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:58.800496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c41adb5-7ef6-4f70-9b62-a815beb94016 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1465 microversion: 2.1 time: 0.423201 Jun 03 09:05:58.802900 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 75/146] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:58 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1465 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:58.876892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:58.877474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:58.886803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:58.887324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:58.888107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:58.888750 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:58.922144 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:05:59.060130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7a958dd3-20de-4560-8c7d-b892c4bdf815 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 204 len: 0 microversion: 2.1 time: 0.187173 Jun 03 09:05:59.061732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 72/147] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:05:58 2022] DELETE /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 09:05:59.077208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:05:59.078642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:05:59.094136 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:59.096855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:59.097790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:05:59.098343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:05:59.422702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:05:59.441376 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2873bc49-09da-4c69-9b26-dc176a6b4835 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1471 microversion: 2.1 time: 0.374801 Jun 03 09:05:59.442575 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 76/148] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:05:59 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:05:59.918789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-254927892", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:00.002909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] validate_networks() for [('917f593f-8fb1-4e02-9381-ebc158d32664', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:06:00.461522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:00.462770 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:00.478014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:00.479685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:00.481307 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:00.482247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:00.587477 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:06:00.587940 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:06:00.588646 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:06:00.589072 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:06:00.589493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:06:00.602728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:00.603608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:00.604924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:00.605598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:00.628276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:06:00.633683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for user 3d8fbafbd63c4e1c946b414e2842eb91 and project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:06:00.648809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:06:00.651883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:06:00.766562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-16a307f9-3e4f-4f70-a480-975f21e6052d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.262005 Jun 03 09:06:00.772318 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 73/149] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:05:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:06:00.783261 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:00.793595 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0af00b70-540b-4bf3-a93d-d95f51b72060 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:00.794987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0af00b70-540b-4bf3-a93d-d95f51b72060 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:00.796394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cfd23028-a0ff-4e9f-bdde-cd14fc20e43a tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1471 microversion: 2.1 time: 0.339847 Jun 03 09:06:00.799802 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 77/150] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:00 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1471 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:06:00.928990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0af00b70-540b-4bf3-a93d-d95f51b72060 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:00.939242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0af00b70-540b-4bf3-a93d-d95f51b72060 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1221 microversion: 2.1 time: 0.157040 Jun 03 09:06:00.942517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 74/151] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:00 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:06:01.224643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1244038125", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:01.380054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] validate_networks() for [('917f593f-8fb1-4e02-9381-ebc158d32664', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:06:01.814543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:01.815175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:01.822996 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:01.827967 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:01.828917 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:01.831482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:02.274613 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:02.291440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b52ef77a-8460-4e7e-9f63-7a683be7c3ec tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1429 microversion: 2.1 time: 0.477413 Jun 03 09:06:02.304204 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 75/152] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:01 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1429 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:02.438533 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-c3ed7837-a26a-47d5-af1d-46b4019ba857 req-09ae2b9b-a119-4f5b-8d1d-09f330c143b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d75dd0-6059-4062-8163-976091600985", "name": "network-vif-deleted", "tag": "861ca9a1-52cb-48ea-beb0-1573ba1b123c"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:02.490854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-c3ed7837-a26a-47d5-af1d-46b4019ba857 req-09ae2b9b-a119-4f5b-8d1d-09f330c143b8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:02.491316 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-c3ed7837-a26a-47d5-af1d-46b4019ba857 req-09ae2b9b-a119-4f5b-8d1d-09f330c143b8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:02.536872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-c3ed7837-a26a-47d5-af1d-46b4019ba857 req-09ae2b9b-a119-4f5b-8d1d-09f330c143b8 service nova] Creating event network-vif-deleted:861ca9a1-52cb-48ea-beb0-1573ba1b123c for instance e4d75dd0-6059-4062-8163-976091600985 on hv-cinder-81268 Jun 03 09:06:02.544887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-c3ed7837-a26a-47d5-af1d-46b4019ba857 req-09ae2b9b-a119-4f5b-8d1d-09f330c143b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111191 Jun 03 09:06:02.549416 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 76/153] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:06:03.291004 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:06:03.292704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:06:03.294113 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:06:03.296437 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:06:03.297833 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:06:03.311958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:03.314927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:03.353307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:03.358180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:03.359083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:03.366150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:03.367340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:03.369656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:03.370812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:03.371421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:03.455573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:06:03.486074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for user 3d8fbafbd63c4e1c946b414e2842eb91 and project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:06:03.525169 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:06:03.525546 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:03.526343 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:03.527196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lazy-loading 'fault' on Instance uuid e4d75dd0-6059-4062-8163-976091600985 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:06:03.532575 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:06:03.616104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ddf38c91-53c3-41f7-a2f3-f2591155e85b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.400053 Jun 03 09:06:03.617718 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 78/154] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:06:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:06:03.636579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6b644c66-d566-4f43-a7e6-15430f17f15f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:03.644331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6b644c66-d566-4f43-a7e6-15430f17f15f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:03.718205 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a1e4c97d634eb88e454f9e36424d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1843cdd14b54fd18d9c4623343ed5f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:03.738509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c8c3ab8f-90e5-43d1-9252-daa507605e10 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 200 len: 1305 microversion: 2.1 time: 0.432478 Jun 03 09:06:03.741655 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 77/155] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:03 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 1305 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:06:03.830298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6b644c66-d566-4f43-a7e6-15430f17f15f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:03.845319 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6b644c66-d566-4f43-a7e6-15430f17f15f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1222 microversion: 2.1 time: 0.218364 Jun 03 09:06:03.847657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 79/156] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:03 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:04.759347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:04.760842 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] [instance: e4d75dd0-6059-4062-8163-976091600985] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:04.783040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:04.783488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:04.784651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:04.785600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:04.798773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:04.879304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:04.885218 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:04.899498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] HTTP exception thrown: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. Jun 03 09:06:04.919186 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Request method failure captured: Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 HTTP/1.1 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc7TW_MIH1tFTejslK7q8uf66YeUqH43cZPToF89BSl3oz0hzeWc8vrF9DKYLIXSR4W9f8IJJltMOHftFWKyiRHLyqDBI1Q-ew2FS8GXIcXUr34xK_d2LFYZXuIGpwG6A4pvTt_h5SnqP2N9fJOmwLkoC4h5tczy5p1FVo-x9gwoWJs Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: e1843cdd14b54fd18d9c4623343ed5f7 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesNegativeTest-357812604 Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:06:04.920768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e1843cdd14b54fd18d9c4623343ed5f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e1843cdd14b54fd18d9c4623343ed5f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e1843cdd14b54fd18d9c4623343ed5f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e1843cdd14b54fd18d9c4623343ed5f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesNegativeTest-357812604 Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: e1843cdd14b54fd18d9c4623343ed5f7 Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesNegativeTest-357812604 Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesNegativeTest-357812604-project Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: f3a1e4c97d634eb88e454f9e36424d45 Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesNegativeTest-357812604-project Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. Jun 03 09:06:04.922151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'e4d75dd0-6059-4062-8163-976091600985'} Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:06:04.922978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. Jun 03 09:06:04.924291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:06:04.925288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] Returning 404 to user: Instance e4d75dd0-6059-4062-8163-976091600985 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:06:04.925288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-719af43e-6939-47c5-ac0f-06ef33c1c674 tempest-VolumesNegativeTest-357812604 tempest-VolumesNegativeTest-357812604-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985" status: 404 len: 111 microversion: 2.1 time: 0.170186 Jun 03 09:06:04.927409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:04.929318 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 78/157] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:04 2022] GET /compute/v2.1/servers/e4d75dd0-6059-4062-8163-976091600985 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:06:04.939435 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:04.946984 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:05.151278 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:05.163983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d451d334-c893-4e86-bdfa-32005171cd73 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1218 microversion: 2.1 time: 0.290428 Jun 03 09:06:05.166444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 80/158] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:04 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:06.185367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:06.186166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:06.199667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:06.201924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:06.203196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:06.203991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:06.444562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:06.463607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b3051202-3605-49ab-8672-439a1b10cc7a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1280 microversion: 2.1 time: 0.284059 Jun 03 09:06:06.464852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 79/159] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:06 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:06.939437 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-53cd33bb-e769-40fa-8201-c2861167e685 req-2cd7da81-8784-48d3-8639-24d6098a44b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c6e82d-0519-446f-8cca-e6b14fbdcf01", "tag": "b6234620-8e7f-462f-866d-2a556b7500b9"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:06.943718 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:06.972188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-53cd33bb-e769-40fa-8201-c2861167e685 req-2cd7da81-8784-48d3-8639-24d6098a44b1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:06.986736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-53cd33bb-e769-40fa-8201-c2861167e685 req-2cd7da81-8784-48d3-8639-24d6098a44b1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:07.010542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-53cd33bb-e769-40fa-8201-c2861167e685 req-2cd7da81-8784-48d3-8639-24d6098a44b1 service nova] Creating event network-changed:b6234620-8e7f-462f-866d-2a556b7500b9 for instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 on hv-cinder-81268 Jun 03 09:06:07.032922 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-53cd33bb-e769-40fa-8201-c2861167e685 req-2cd7da81-8784-48d3-8639-24d6098a44b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099342 Jun 03 09:06:07.043894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 81/160] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:06:07.480401 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:07.481700 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:07.500491 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:07.501324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:07.505103 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:07.506297 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:07.778764 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:07.789200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-33a180c3-1885-4aa3-80c4-cc6db5058a27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.312609 Jun 03 09:06:07.801259 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 80/161] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:07 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:08.399379 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-5bf25083-112c-4cb5-9751-f1dd6ab446a9 req-d146db2a-a1b2-435f-b60c-585b3403be8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4489255-77da-411b-b2ab-c394031a65f6", "tag": "fca4eadf-000a-44f7-8901-956a84dbd765"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:08.438333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5bf25083-112c-4cb5-9751-f1dd6ab446a9 req-d146db2a-a1b2-435f-b60c-585b3403be8e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:08.439091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5bf25083-112c-4cb5-9751-f1dd6ab446a9 req-d146db2a-a1b2-435f-b60c-585b3403be8e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:08.451189 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-5bf25083-112c-4cb5-9751-f1dd6ab446a9 req-d146db2a-a1b2-435f-b60c-585b3403be8e service nova] Creating event network-changed:fca4eadf-000a-44f7-8901-956a84dbd765 for instance f4489255-77da-411b-b2ab-c394031a65f6 on hv-cinder-81268 Jun 03 09:06:08.456893 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-5bf25083-112c-4cb5-9751-f1dd6ab446a9 req-d146db2a-a1b2-435f-b60c-585b3403be8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068368 Jun 03 09:06:08.457372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 82/162] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:06:08.820952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:08.821850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:08.828431 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:08.830228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:08.830856 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:08.832087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:08.833495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:09.226718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:09.239846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-193c24ba-d014-4a56-84c4-33177197cff4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.424300 Jun 03 09:06:09.240992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 81/163] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:08 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:10.261484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:10.262582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:10.268810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:10.269258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:10.270020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:10.270466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:10.400690 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:10.408713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec3a532c-2c00-4948-a2cf-11d73aa91164 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.152014 Jun 03 09:06:10.409285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 83/164] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:10 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:11.425571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:11.426113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:11.427983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:11.428658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=8 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:11.434762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:11.435198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:11.435994 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:11.438552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:11.573542 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:11.580990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b12d4f10-ab79-4b6b-a9dc-c898b44c6c04 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.159304 Jun 03 09:06:11.581560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 82/165] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:11 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:12.598639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:12.599185 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:12.606658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:12.607107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:12.607999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:12.608434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:12.734389 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:12.741811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-12052e29-4f68-499b-88aa-ffa6c5848388 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.147133 Jun 03 09:06:12.742392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 84/166] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:12 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:13.761373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:13.762013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:13.769536 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:13.769987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:13.770946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:13.771420 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:13.914854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:13.923618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3bdbb87d-e3ed-4d70-a0b8-50ed02448252 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.168147 Jun 03 09:06:13.924219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 83/167] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:13 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:14.940922 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:14.941525 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:14.943463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:14.944600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=8 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:14.950371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:14.950813 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:14.951572 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:14.952029 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:15.087085 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:15.095121 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad47a9f8-080f-4406-839f-793598099813 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.158009 Jun 03 09:06:15.095776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 85/168] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:14 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:16.111865 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:16.112471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:16.118637 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:16.119085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:16.119888 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:16.120323 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:16.257634 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:16.265988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-20db6bb9-37e2-419e-8918-a58810913213 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.158018 Jun 03 09:06:16.266769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 84/169] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:16 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:17.282521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:17.283128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:17.289678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:17.290407 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:17.291167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:17.291591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:17.294364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=81 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:17.430767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:17.438793 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2baec7fc-cfb6-49f7-bd85-4fd66b29989e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.160111 Jun 03 09:06:17.439401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 86/170] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:17 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:18.454967 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:18.455585 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:18.461668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:18.462116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:18.462871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:18.463306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:18.595381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:18.602892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-36d6901f-c565-4a5a-8a41-bc2c6645bf91 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.151754 Jun 03 09:06:18.603461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 85/171] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:18 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:19.619806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:19.620413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:19.626933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:19.627318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:19.628098 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:19.628530 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:19.766664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:19.774423 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3478418d-5cf4-440d-969e-b5f68aa128a2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.158516 Jun 03 09:06:19.775006 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 87/172] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:19 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:20.796229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:20.796878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:20.804078 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:20.804922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:20.805940 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:20.806594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:21.371305 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:21.401149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2ad9e619-0904-4f4d-9445-fa9d0b58c70e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.612195 Jun 03 09:06:21.401791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 86/173] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:20 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:21.442242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-9c4b4492-62b2-4b67-842c-2fef5d29ef1f req-5a3f304c-7b10-4a9b-a214-c2c9ff46afde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c6e82d-0519-446f-8cca-e6b14fbdcf01", "name": "network-vif-plugged", "status": "completed", "tag": "b6234620-8e7f-462f-866d-2a556b7500b9"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:21.459623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9c4b4492-62b2-4b67-842c-2fef5d29ef1f req-5a3f304c-7b10-4a9b-a214-c2c9ff46afde service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:21.460274 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9c4b4492-62b2-4b67-842c-2fef5d29ef1f req-5a3f304c-7b10-4a9b-a214-c2c9ff46afde service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:21.490826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-9c4b4492-62b2-4b67-842c-2fef5d29ef1f req-5a3f304c-7b10-4a9b-a214-c2c9ff46afde service nova] Creating event network-vif-plugged:b6234620-8e7f-462f-866d-2a556b7500b9 for instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 on hv-cinder-81268 Jun 03 09:06:21.501081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-9c4b4492-62b2-4b67-842c-2fef5d29ef1f req-5a3f304c-7b10-4a9b-a214-c2c9ff46afde service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060982 Jun 03 09:06:21.502902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 88/174] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:06:22.422962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:22.423985 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:22.430834 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:22.431547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:22.432365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:22.432827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:22.593105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:22.600557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d31e1dba-d3cf-4181-bbe3-b3910886daac tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.182016 Jun 03 09:06:22.610208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 87/175] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:22 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:23.618675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:23.619372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:23.626640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:23.627088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:23.628022 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:23.628355 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:23.792716 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:23.802576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c73b081-a8c0-4dd6-bc75-a900dd4d5b11 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.188569 Jun 03 09:06:23.803456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 89/176] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:23 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:24.821026 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:24.821568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:24.829110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:24.829650 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:24.830492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:24.830959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:25.045177 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:25.057440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-eb651de7-bf06-4026-b7bc-a8960714f1d5 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.241056 Jun 03 09:06:25.064412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 88/177] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:24 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:26.079458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:26.081521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:26.103646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:26.113190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:26.115016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:26.115710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:26.352065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:26.360982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a044343f-5b10-486f-b066-3cd06184bb37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.288937 Jun 03 09:06:26.362583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 90/178] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:26 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:27.381120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:27.384732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:27.397470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:27.398378 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:27.399883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:27.400670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:27.615655 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:27.635736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c37a862a-c7f0-4a28-8f58-07fe66b45770 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.260337 Jun 03 09:06:27.645948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 89/179] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:27 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:28.652827 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:28.653968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:28.660617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:28.661076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:28.661852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:28.662293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:28.822032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:28.830951 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-147f5c49-15dd-450a-b2fc-ef7830eec896 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.182165 Jun 03 09:06:28.831655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 91/180] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:28 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:29.276037 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-7937790e-734a-4708-b64b-aca6bd069a2d req-86c89991-ef8d-4915-aa4b-ef1c613c1077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4489255-77da-411b-b2ab-c394031a65f6", "name": "network-vif-plugged", "status": "completed", "tag": "fca4eadf-000a-44f7-8901-956a84dbd765"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:29.289690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-7937790e-734a-4708-b64b-aca6bd069a2d req-86c89991-ef8d-4915-aa4b-ef1c613c1077 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:29.290628 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-7937790e-734a-4708-b64b-aca6bd069a2d req-86c89991-ef8d-4915-aa4b-ef1c613c1077 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:29.304953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-7937790e-734a-4708-b64b-aca6bd069a2d req-86c89991-ef8d-4915-aa4b-ef1c613c1077 service nova] Creating event network-vif-plugged:fca4eadf-000a-44f7-8901-956a84dbd765 for instance f4489255-77da-411b-b2ab-c394031a65f6 on hv-cinder-81268 Jun 03 09:06:29.311199 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-7937790e-734a-4708-b64b-aca6bd069a2d req-86c89991-ef8d-4915-aa4b-ef1c613c1077 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039336 Jun 03 09:06:29.312247 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 90/181] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:06:29.848939 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:29.849553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:29.856912 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:29.857365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:29.858126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:29.858565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:29.985931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:29.993470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-beedb8dc-aaea-4fd4-b3d2-cc4bbc75779d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.148437 Jun 03 09:06:29.994054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 92/182] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:29 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:31.010763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:31.011461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:31.018774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:31.019224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:31.020022 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:31.020461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:31.152698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:31.160083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4fa78af1-e8c0-4908-867a-faf4f3ffe3ae tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.153407 Jun 03 09:06:31.160647 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 91/183] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:31 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:32.177368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:32.177990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:32.184480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:32.184928 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:32.185689 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:32.186125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:32.317586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:32.325777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b95a101c-c55a-454b-88a3-33e9c993434e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.151721 Jun 03 09:06:32.326340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 93/184] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:32 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:33.342927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:33.343539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:33.349895 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:33.350351 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:33.351124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:33.351561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:33.487199 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:33.494580 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f7950d7a-4d43-412a-aecb-b6a59575f5cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.156029 Jun 03 09:06:33.495150 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 92/185] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:33 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:34.513249 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:34.513881 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:34.521172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:34.521628 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:34.522418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:34.522941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:34.700889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:34.710324 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3720d677-32d8-4121-9ebd-2dd0cd4eed40 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1322 microversion: 2.1 time: 0.202142 Jun 03 09:06:34.711165 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 94/186] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:34 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:35.729221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:35.729834 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:35.736518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:35.736964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:35.737726 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:35.738159 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:35.869288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:35.878311 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6799f029-da6a-44a6-bf2e-38e756588d0b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1516 microversion: 2.1 time: 0.152832 Jun 03 09:06:35.878907 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 93/187] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:35 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:35.894514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:06:35.895556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:35.902103 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:35.902620 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:35.903387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:35.903859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:35.926736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'flavor' on Instance uuid f4489255-77da-411b-b2ab-c394031a65f6 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:06:36.054399 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7a3e486-c8dd-4f63-a19a-5b38767f38fb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6/action" status: 200 len: 32 microversion: 2.1 time: 0.158308 Jun 03 09:06:36.054399 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 95/188] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:06:35 2022] POST /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:06:36.061035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:36.061762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:36.067939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:36.068619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:36.069201 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:36.069640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:36.208453 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:36.210832 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=92 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:36.218516 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b66b6224-5185-4766-8b6d-241e0c84f84a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.161397 Jun 03 09:06:36.219114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 94/189] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:36 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:37.237522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:37.238288 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:37.240453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=30 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:37.247805 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:37.248176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:37.248988 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:37.249452 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:37.380078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:37.387617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c303a322-35e8-4707-801a-e8cb9b896108 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.155164 Jun 03 09:06:37.388223 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 96/190] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:37 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:38.404570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:38.405178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:38.411493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:38.412014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:38.412911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:38.413349 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:38.544516 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:38.551911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bacebefc-a739-48c3-90d9-affaa3f96b7b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.151458 Jun 03 09:06:38.552482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 95/191] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:38 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:39.569581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:39.570143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:39.577511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:39.577960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:39.578719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:39.579155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:39.708485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:39.717093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-965c44ce-ebe8-4c8f-a6db-5ad87d5154f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.151561 Jun 03 09:06:39.717674 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 97/192] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:39 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:40.733967 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:40.734572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:40.736495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=30 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:40.742147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:40.742591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:40.743346 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:40.743799 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:40.884219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:40.892307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-723c23de-0490-4316-955e-9ba3715a2fb7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.162848 Jun 03 09:06:40.892887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 96/193] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:40 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:41.909158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:41.909769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:41.916581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:41.917036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:41.917807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:41.918243 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:42.053579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:42.061180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7b774a45-7df8-4a69-890d-044162db53eb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.155867 Jun 03 09:06:42.061757 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 98/194] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:41 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:43.077672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:43.078395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:43.084288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:43.084729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:43.085475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:43.085900 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:43.229665 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:43.240223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4d80fc2f-7445-4538-b3ca-8acae908bf22 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.166760 Jun 03 09:06:43.250026 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 97/195] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:43 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:44.258161 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:44.258774 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:44.266187 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:44.266425 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:44.267194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:44.267628 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:44.406226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:44.415531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9bdcdad5-057c-4eb7-bf09-417b09744cdb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.161600 Jun 03 09:06:44.416326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 99/196] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:44 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:45.432942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:45.433544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:45.440327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:45.440766 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:45.441511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:45.441938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:45.571777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:45.579231 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ac4cfa88-3697-4784-a777-46d0bc827444 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.150101 Jun 03 09:06:45.580036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 98/197] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:45 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:46.596544 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:46.597054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:46.603676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:46.604227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:46.604989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:46.605419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:46.737943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:46.745651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2b4c1702-e483-45e8-9e23-53a8d209267e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.152994 Jun 03 09:06:46.746211 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 100/198] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:46 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:47.762293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:47.762899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:47.768974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:47.769421 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:47.770180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:47.770681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:47.920489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:47.929090 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-95a64d13-efa6-4655-bc82-86d41b820723 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.170531 Jun 03 09:06:47.929679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 99/199] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:47 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:48.945053 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:48.945664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:48.952883 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:48.953335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:48.954095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:48.954525 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:48.957113 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:49.091888 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:49.099380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-65122473-53cd-4c30-860a-0c18f6de36c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.158080 Jun 03 09:06:49.099986 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 101/200] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:48 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:50.117960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:50.118565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:50.125561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:50.126006 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:50.126759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:50.127190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:50.254459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:50.261867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-374620c0-2054-4366-a4e5-9099d7e6d467 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.148058 Jun 03 09:06:50.262438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 100/201] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:50 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:51.278466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:51.278998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:51.285554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:51.285999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:51.286760 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:51.287194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:51.417712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:51.425621 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2108e2b1-9fdc-4528-bb20-17040b31a241 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.151090 Jun 03 09:06:51.426193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 102/202] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:51 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:52.442774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:52.443312 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:52.449147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:52.450142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:52.450844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:52.451276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:52.582111 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:52.589426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c3e4768f-e0aa-48ef-a721-789d4811eced tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.150768 Jun 03 09:06:52.589995 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 101/203] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:52 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:53.608622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:53.609235 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:53.615666 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:53.616142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:53.616902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:53.617333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:53.747126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:53.754517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5c9825bc-3be1-4651-b62e-16bb0af8429a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.150393 Jun 03 09:06:53.755143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 103/204] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:53 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:54.773792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:54.773792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:54.779191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:54.779634 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:54.780418 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:54.780861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:54.909475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:54.917076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-467b8c54-99be-45a4-af3e-1bd2bd831130 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.149457 Jun 03 09:06:54.917642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 102/205] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:54 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:55.934432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:55.935609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:55.942038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:55.942477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:55.943227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:55.943655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:56.075417 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:56.086172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb1a2a79-5041-4f62-9d80-99ba3c691d37 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.155431 Jun 03 09:06:56.086975 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 104/206] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:55 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:57.103341 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:57.103980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:57.110780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:57.111218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:57.112008 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:57.112430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:57.240029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:57.247723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a1aad162-1edb-42d7-9952-6b805fb066b7 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.148162 Jun 03 09:06:57.248309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 103/207] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:57 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:58.265109 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:58.265661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:58.272218 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:58.272670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:58.273435 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:58.273868 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:58.408018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:58.416428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a5ae63d-0f51-4a97-902a-6a88cd2ea504 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.155778 Jun 03 09:06:58.417066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 105/208] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:58 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:06:59.433685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:06:59.434293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:06:59.440352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:59.440797 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:59.441553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:06:59.441987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:06:59.571119 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:06:59.578502 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0996d582-6702-416e-8a0a-106569037f65 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.148998 Jun 03 09:06:59.579059 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 104/209] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:06:59 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:00.595643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:00.596436 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:00.602586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:00.603020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:00.603778 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:00.604247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:00.742007 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:00.753390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f88f4ee7-b5be-40b7-a8a7-16dba3db903e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.161621 Jun 03 09:07:00.755625 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 106/210] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:00 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:01.772528 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:01.773139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:01.779112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:01.779561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:01.780367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:01.780798 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:02.181498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:02.190332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-185e4ab2-073c-4474-994c-1926b01dcba4 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.421395 Jun 03 09:07:02.190983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 105/211] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:01 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:03.207040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:03.207655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:03.214167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:03.214612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:03.215368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:03.216325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:03.345272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:03.352765 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6b448daf-bc69-4c0a-a0f1-9751611245ca tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.149636 Jun 03 09:07:03.353327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 107/212] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:03 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:04.370095 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:04.370733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:04.377533 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:04.378005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:04.378721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:04.379154 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:04.505077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:04.512526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2ac1653b-6e34-4bd9-8be0-8f6fa8bdd52a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.146265 Jun 03 09:07:04.513107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 106/213] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:04 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:05.529369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:05.529962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:05.536449 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:05.536888 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:05.537642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:05.538072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:05.667177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:05.675131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4c55f1f7-d6ea-4f60-bb50-6058ee5cf81e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.149651 Jun 03 09:07:05.675706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 108/214] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:05 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:06.691477 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:06.692226 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:06.698292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:06.698736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:06.699497 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:06.700466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:06.831229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:06.838562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-23a44315-98d7-4ccf-85a0-f95d1acc199e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.150867 Jun 03 09:07:06.839113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 107/215] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:06 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:07.854415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:07.855178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:07.858251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=26 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:07.864025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:07.864445 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:07.865281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:07.865716 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:08.022602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:08.031194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5ce075b9-53e7-4ee2-803c-b8cfbef45ae2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.180684 Jun 03 09:07:08.031794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 109/216] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:07 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:09.049185 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:09.049784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:09.055873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:09.056318 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:09.057060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:09.057483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:09.059975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=80 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:09.183451 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:09.190867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b5186217-72f3-4a39-91a0-228874c97ccc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.145488 Jun 03 09:07:09.191428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 108/217] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:09 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:10.207690 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:10.208359 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:10.215415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:10.215897 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:10.216651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:10.217083 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:10.351901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:10.359992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-01dec2eb-4eda-4ef1-9bd7-14b06802002d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.156088 Jun 03 09:07:10.360579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 110/218] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:10 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:11.377204 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:11.377817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:11.380766 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=26 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:11.385102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:11.385843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:11.386384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:11.386823 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:11.570175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:11.579461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-446537bd-fb3e-4fd9-84fa-9ec546a66f98 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.206090 Jun 03 09:07:11.580083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 109/219] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:11 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:12.597020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:12.597770 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:12.604553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:12.605030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:12.605783 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:12.606241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:12.743101 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:12.751084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4000fe5a-2dbe-4de1-b184-6835e4bcc230 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.158031 Jun 03 09:07:12.751654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 111/220] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:12 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:13.768010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:13.768619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:13.774943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:13.775394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:13.776242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:13.776631 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:13.912097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:13.920786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ad6aef6b-b58a-4cbc-b721-859fabd72f80 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.156617 Jun 03 09:07:13.921358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 110/221] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:13 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:07:14.937057 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:14.937592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:14.944143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:14.944587 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:14.945352 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:14.945786 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:15.074596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:15.082565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b93f7b77-5225-4ad9-b617-ce1da9b30b3f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.149430 Jun 03 09:07:15.083139 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 112/222] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:14 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:16.101164 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:16.101782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:16.108488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:16.108935 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:16.109711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:16.110148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:16.246326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:16.255747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fc97a59b-c750-4147-b136-edc635e3acc2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.159251 Jun 03 09:07:16.256348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 111/223] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:16 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:17.273224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:17.273847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:17.280619 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:17.281071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:17.281842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:17.282280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:17.412574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:17.420386 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-76dd28d2-974e-434c-a6c6-da05a6c5f7cd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1522 microversion: 2.1 time: 0.151295 Jun 03 09:07:17.420947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 113/224] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:17 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:18.436469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:18.437192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:18.443188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:18.443622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:18.444408 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:18.444841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:18.602550 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:18.612422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-84f00139-e676-439e-8e05-bc83fda0ed2c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1502 microversion: 2.1 time: 0.179743 Jun 03 09:07:18.613336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 112/225] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:18 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:18.629436 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:18.630056 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:18.636703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:18.637362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:18.638745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:18.639280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:18.773319 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:18.780624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9f351053-8785-47f1-a60d-4622eaf588bc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1515 microversion: 2.1 time: 0.154998 Jun 03 09:07:18.781179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 114/226] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:18 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:20.133800 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:20.134754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:20.141368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:20.141818 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:20.142573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:20.143011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:20.168124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'flavor' on Instance uuid b5c6e82d-0519-446f-8cca-e6b14fbdcf01 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:07:20.279671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-734dbea0-b2f9-4576-ade7-35870bd8eb9e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/action" status: 200 len: 32 microversion: 2.1 time: 0.150118 Jun 03 09:07:20.280339 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 113/227] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:07:20 2022] POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:07:20.289570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:20.290788 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:20.298143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:20.298638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:20.299416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:20.299930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:20.304104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=84 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:20.435809 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:20.443277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-94bf782b-bb0c-43c5-bc60-c603ed4a6531 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.157818 Jun 03 09:07:20.443875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 115/228] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:20 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:21.461511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:21.462131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:21.468357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:21.468815 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:21.469575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:21.470009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:21.600885 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:21.608813 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e6a5c1a6-d003-4a04-87a0-8ab958d6d96a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.151704 Jun 03 09:07:21.609378 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 114/229] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:21 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:22.626214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:22.626824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:22.633481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:22.633930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:22.634688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:22.635125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:22.761397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:22.769315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d36fd33-de0b-4ce5-9a3a-f1b057bdf749 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.147511 Jun 03 09:07:22.769919 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 116/230] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:22 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:23.786304 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:23.786919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:23.793335 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:23.793832 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:23.795164 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:23.795665 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:23.931867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:23.939902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-477a7b09-9b05-48c1-bfd3-35914acd3939 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.157426 Jun 03 09:07:23.940476 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 115/231] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:23 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:24.957211 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:24.957816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:24.964415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:24.964826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:24.965592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:24.966678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:25.097999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:25.105422 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d60097bf-1492-4dbb-9a64-19663aec053e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.152085 Jun 03 09:07:25.106008 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 117/232] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:24 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:26.122641 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:26.123277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:26.129283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:26.129723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:26.130465 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:26.130890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:26.257165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:26.264571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5d3d0ac7-ae20-4d34-a8e5-beb6485f2859 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.146256 Jun 03 09:07:26.265138 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 116/233] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:26 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:27.282483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:27.283018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:27.289951 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:27.290404 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:27.291177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:27.291613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:27.420088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:27.427537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-952a7c33-d35f-4aaa-901b-f1932c9d49d9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.149559 Jun 03 09:07:27.428130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 118/234] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:27 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:28.444236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:28.444836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:28.451444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:28.451926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:28.452701 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:28.453109 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:28.586626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:28.594202 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dae9f2c0-b15a-4956-b06f-7828b40c6207 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.153776 Jun 03 09:07:28.594808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 117/235] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:28 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:29.610355 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:29.610958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:29.617465 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:29.617913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:29.618658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:29.619090 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:29.744929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:29.752864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ff65f76b-137f-4976-8fd6-242f946d2304 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.146412 Jun 03 09:07:29.753577 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 119/236] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:29 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:30.770184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:30.770841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:30.776964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:30.777411 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:30.778181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:30.779282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:30.919248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:30.926679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d67a1b07-b9a5-4045-8278-87c7d9adf39e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.160595 Jun 03 09:07:30.927251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 118/237] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:30 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:31.943534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:31.944155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:31.950797 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:31.951236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:31.952021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:31.952450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:32.088336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:32.096342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0e9efec2-4e59-4315-8fcf-879f3cbcda05 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.156748 Jun 03 09:07:32.096923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 120/238] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:31 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:07:33.113479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:33.114112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:33.120333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:33.120774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:33.121592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:33.122571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:33.257767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:33.265623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8f54c385-b2b8-4a74-9f9a-5ad2c9006053 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.155972 Jun 03 09:07:33.266189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 119/239] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:33 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:34.282709 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:34.283330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:34.290450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:34.291052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:34.291863 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:34.292331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:34.435493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:34.443327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5ca0b07f-f769-4039-a1bc-d1fe080565d6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.164767 Jun 03 09:07:34.443942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 121/240] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:34 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:35.463857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:35.464571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:35.470933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.471371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.472206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.472660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.609346 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:35.616723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-29b4bf12-7108-426b-b366-dddb00570b13 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1501 microversion: 2.1 time: 0.157501 Jun 03 09:07:35.617287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 120/241] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:35 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:35.632765 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4e08019-53bb-4ef4-90f8-581dcf3bfaf0"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:35.633836 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:35.640804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.641318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.642321 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.642889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.667906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] HTTP exception thrown: Cannot 'attach_volume' instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 while it is in vm_state rescued Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Request method failure captured: Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/os-volume_attachments HTTP/1.1 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 74 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc73ctoiRmLt8EVyZOLRx5b0zVVA3wygWU4BbNCjns6QQa8Z4_d_A-lBpi05iJXcmK9dViZwPIkV5ZD8VqhzLPMYYK__trQ7lwqlUBejjaZkk_inJQhlfsw8daDtZBzyKHjAaDNm7PkCujEEqDiFZrI-aBaimHcefyib54sTZtaDDR0 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:07:35.670175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 3d8fbafbd63c4e1c946b414e2842eb91 Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {"volumeAttachment": {"volumeId": "e4e08019-53bb-4ef4-90f8-581dcf3bfaf0"}} Jun 03 09:07:35.671732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Cannot 'attach_volume' instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 while it is in vm_state rescued Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'server_id': 'b5c6e82d-0519-446f-8cca-e6b14fbdcf01', 'body': {'volumeAttachment': {'volumeId': 'e4e08019-53bb-4ef4-90f8-581dcf3bfaf0'}}} Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:07:35.672772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 while it is in vm_state rescued Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:07:35.674174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 while it is in vm_state rescued Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Returning 409 to user: Cannot 'attach_volume' instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 while it is in vm_state rescued {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2ff93e5b-67a9-48e8-a40b-0818ce8deb90 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042817 Jun 03 09:07:35.675646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 122/242] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:07:35 2022] POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 09:07:35.680610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:35.681132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:35.687120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.687556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.688325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.688750 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.746324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:35.757976 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6cc7db27-3b2e-4c27-926a-b8a0a3acc23d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/action" status: 202 len: 0 microversion: 2.1 time: 0.080889 Jun 03 09:07:35.758683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 121/243] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:07:35 2022] POST /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:07:35.767722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:35.768575 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:35.776017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.776475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.777252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:35.777694 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:35.926876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:35.938415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7ba0a178-7bc9-45c5-89ef-525fb8c07294 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1509 microversion: 2.1 time: 0.175446 Jun 03 09:07:35.938994 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 123/244] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:35 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:36.958072 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:36.958684 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:36.965205 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:36.966213 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:36.966967 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:36.967397 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:37.099587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:37.107156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c71102a5-2f4e-448b-a69a-c836cbe6733e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1509 microversion: 2.1 time: 0.154386 Jun 03 09:07:37.107724 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 122/245] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:36 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:38.124276 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:38.124938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:38.127205 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=30 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:38.132673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:38.133123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:38.133890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:38.134325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:38.268672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:38.276097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-368c5a33-524d-43fb-aec3-bfe11651f3cb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1509 microversion: 2.1 time: 0.155689 Jun 03 09:07:38.276669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 124/246] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:38 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:39.293990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:39.294853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:39.300827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:39.301277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:39.302043 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:39.302482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:39.445553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:39.453719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-98f41a15-aad8-4b54-9e32-c77d49af942a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1509 microversion: 2.1 time: 0.164031 Jun 03 09:07:39.454287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 123/247] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:39 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:40.470914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:40.471587 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:40.478084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:40.478531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:40.479292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:40.479726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:40.612177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:40.619724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-11e1f5a4-579d-49d4-8236-d803d7e4241e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1515 microversion: 2.1 time: 0.152662 Jun 03 09:07:40.620266 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 125/248] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:40 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:41.968876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c1334600-94c0-460d-a39b-327ad3d9ed7c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: .version_select at 0x7fd2b1521940>, body: {"keypair": {"name": "tempest-keypair-518512375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmT2oAYjT0JzMKeC6J2YZYQrfNVw4RrjVVsagC1gEECkFCXrjrt8MQ9yyvNm2yHoIBiSxQZ0rc9J7GgeGAEqIpLj1l1moRBszRljf92XcUOXjP9DANoh8xupESv+PKLrQ=="}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:41.972935 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=30 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:41.983578 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c1334600-94c0-460d-a39b-327ad3d9ed7c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:07:41.987983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c1334600-94c0-460d-a39b-327ad3d9ed7c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for user 3d8fbafbd63c4e1c946b414e2842eb91 and project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:07:42.019005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c1334600-94c0-460d-a39b-327ad3d9ed7c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053538 Jun 03 09:07:42.027329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 124/249] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:07:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:07:43.378178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-674590673", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "917f593f-8fb1-4e02-9381-ebc158d32664"}], "security_groups": [{"name": "tempest-securitygroup--1108421552"}], "key_name": "tempest-keypair-518512375", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:43.481542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] validate_networks() for [('917f593f-8fb1-4e02-9381-ebc158d32664', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:07:43.857937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:07:43.858432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:07:43.858907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:07:43.859377 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:07:43.859824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:07:43.868701 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:43.869145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:43.869932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:43.870362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:43.887548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:07:43.892236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Getting quotas for user 3d8fbafbd63c4e1c946b414e2842eb91 and project 74e85f2b75a14a31ac1498fa9ac1d243. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:07:43.906180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:07:43.908498 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:07:43.957383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4f2da2e2-84e6-4de2-9f96-c71555aa5961 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.583448 Jun 03 09:07:43.958060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 126/250] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:07:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:07:43.968626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-27972c8b-bee5-4d47-add8-b17fb98dc728 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:43.969242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-27972c8b-bee5-4d47-add8-b17fb98dc728 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:44.037097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-27972c8b-bee5-4d47-add8-b17fb98dc728 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:44.044050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-27972c8b-bee5-4d47-add8-b17fb98dc728 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1244 microversion: 2.1 time: 0.079693 Jun 03 09:07:44.044621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 125/251] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:43 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:45.061724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:45.062641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:45.071637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:45.072161 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:45.072948 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:45.073389 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:45.141801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:45.151645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad5aa57e-6a26-413e-815e-67b3e3a4505b tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1314 microversion: 2.1 time: 0.093720 Jun 03 09:07:45.161499 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 127/252] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:45 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1314 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:46.170119 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:46.170734 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:46.180539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:46.181207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:46.181997 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:46.182444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:46.326570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:46.334861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf38eb05-94fa-41a7-92cb-2b4f3e368f62 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.168520 Jun 03 09:07:46.345218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 126/253] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:46 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:46.481810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-2c56759c-22c8-4dda-946b-d95e88470c95 req-b739ddc3-8b61-4255-801d-26f46ff8a729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:46.492684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2c56759c-22c8-4dda-946b-d95e88470c95 req-b739ddc3-8b61-4255-801d-26f46ff8a729 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:46.493579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-2c56759c-22c8-4dda-946b-d95e88470c95 req-b739ddc3-8b61-4255-801d-26f46ff8a729 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:46.521468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-2c56759c-22c8-4dda-946b-d95e88470c95 req-b739ddc3-8b61-4255-801d-26f46ff8a729 service nova] Creating event network-changed:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:07:46.527170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-2c56759c-22c8-4dda-946b-d95e88470c95 req-b739ddc3-8b61-4255-801d-26f46ff8a729 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049172 Jun 03 09:07:46.527967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 128/254] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:07:47.352321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:47.352927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:47.359188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:47.359632 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:47.360410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:47.360846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:47.485752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:47.493178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-19548d2d-3e59-4443-b74a-3ee775915137 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.144683 Jun 03 09:07:47.493738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 127/255] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:47 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:48.511215 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:48.511960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:48.518153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:48.518596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:48.519351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:48.519810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:48.649870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:48.657913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb068f20-334a-4411-825e-69954d9f1e78 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.151351 Jun 03 09:07:48.658384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 129/256] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:48 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:49.675153 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:49.675786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:49.681837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:49.682286 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:49.683043 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:49.683474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:49.810627 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:49.817984 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-30a7c358-e324-42ae-a128-cd2f7147919c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.147304 Jun 03 09:07:49.818547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 128/257] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:49 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:50.835063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:50.835674 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:50.842162 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:50.842614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:50.843383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:50.844410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:50.847183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=80 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:50.984534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:50.992305 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-48eb96b7-ac42-4b31-8124-8e7a43f14c27 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.160955 Jun 03 09:07:50.992882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 130/258] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:50 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:52.009420 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:52.010031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:52.016195 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:52.016644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:52.017418 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:52.017844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:52.153706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:52.161816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-26b46659-e8d1-473d-a765-46d45450536e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.156165 Jun 03 09:07:52.162698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 129/259] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:52 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:53.178708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:53.179317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:53.185877 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:53.186329 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:53.187092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:53.188236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:53.316247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:53.323685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df0b3dcd-d7b8-4b00-80c8-2718076eeedf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.148855 Jun 03 09:07:53.324300 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 131/260] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:53 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:53.574273 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-5d3a1101-adbc-4728-bf27-28927b732a8d req-16317f8e-aa02-495b-82ee-6b26f43b38a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "name": "network-vif-plugged", "status": "completed", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:53.583518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-5d3a1101-adbc-4728-bf27-28927b732a8d req-16317f8e-aa02-495b-82ee-6b26f43b38a7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:53.584011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-5d3a1101-adbc-4728-bf27-28927b732a8d req-16317f8e-aa02-495b-82ee-6b26f43b38a7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:53.595766 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-5d3a1101-adbc-4728-bf27-28927b732a8d req-16317f8e-aa02-495b-82ee-6b26f43b38a7 service nova] Creating event network-vif-plugged:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:07:53.601312 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-5d3a1101-adbc-4728-bf27-28927b732a8d req-16317f8e-aa02-495b-82ee-6b26f43b38a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030951 Jun 03 09:07:53.601885 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 130/261] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:07:54.340431 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:54.340961 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:54.342804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:54.344137 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:54.350749 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:54.351189 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:54.351984 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:54.352442 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:54.487784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:54.495265 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-378ebf80-30ca-4220-8296-6cf57df2c2ef tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.158756 Jun 03 09:07:54.495926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 132/262] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:54 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:55.509067 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:55.513811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:55.514501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:55.522584 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:55.522905 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:55.523661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:55.524109 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:55.685518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:55.693592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-698d4165-2715-4633-a644-3c3f24ec4490 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1370 microversion: 2.1 time: 0.185503 Jun 03 09:07:55.694165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 131/263] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:55 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:56.710513 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:56.711808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:56.717953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.718639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.719461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.719921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.849446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:07:56.857078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5ba1d67b-26ce-441c-bafc-934ec97bb36e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1564 microversion: 2.1 time: 0.150572 Jun 03 09:07:56.857641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 133/264] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:07:56 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:07:56.872939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:56.873494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:56.879975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.880406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.881161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.881591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.924796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:56.925327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:56.931598 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.932182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.933087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:56.933590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:56.960795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-28afb77b-0828-498d-90a2-d40d0c13a884 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/ips" status: 200 len: 145 microversion: 2.1 time: 0.040506 Jun 03 09:07:56.961402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 134/265] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:07:56 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:07:56.968586 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2104037d-7472-434f-93f9-03f6bce9703c tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099419 Jun 03 09:07:56.969427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 132/266] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:07:56 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:07:57.506781 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:57.507277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:57.513806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:57.514254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:57.515026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:57.515459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:57.539325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3492b7e-80a7-49d5-b948-7e13b3c01b00 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/ips" status: 200 len: 150 microversion: 2.20 time: 0.036483 Jun 03 09:07:57.539943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 135/267] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jun 3 09:07:57 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:07:58.173597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e79ed109-f989-4dfa-8d8a-167a464a9ed0 req-f91b6563-bfbf-4e5d-90c3-ea0bf6b17fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:58.182261 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e79ed109-f989-4dfa-8d8a-167a464a9ed0 req-f91b6563-bfbf-4e5d-90c3-ea0bf6b17fd9 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:58.182942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e79ed109-f989-4dfa-8d8a-167a464a9ed0 req-f91b6563-bfbf-4e5d-90c3-ea0bf6b17fd9 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:58.195745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e79ed109-f989-4dfa-8d8a-167a464a9ed0 req-f91b6563-bfbf-4e5d-90c3-ea0bf6b17fd9 service nova] Creating event network-changed:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:07:58.201723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e79ed109-f989-4dfa-8d8a-167a464a9ed0 req-f91b6563-bfbf-4e5d-90c3-ea0bf6b17fd9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032025 Jun 03 09:07:58.202449 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 133/268] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:07:59.519882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:59.520479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:59.526998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.527479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.528335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.528799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.554308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lazy-loading 'flavor' on Instance uuid 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:07:59.655321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1565f6fb-a001-4cd3-a714-7615b8796a52"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:07:59.657041 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:59.663260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.663990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.664741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.665171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.822403 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dfbd9f40-39e2-4851-8495-977677f4446a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/action" status: 202 len: 0 microversion: 2.20 time: 0.306382 Jun 03 09:07:59.823447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 136/269] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 09:07:59 2022] POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:07:59.833761 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:07:59.834699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:07:59.847901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.848410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.849116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:07:59.850508 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:07:59.951867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fea5b3ce-a8e8-465a-9cd8-c6ec667b649c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300704 Jun 03 09:07:59.952482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 134/270] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:07:59 2022] POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:07:59.994733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:00.005980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:00.007497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:00.008683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ad7fdb76-b672-488f-8efb-9ceb6f76e1de tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.180119 Jun 03 09:08:00.009287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 137/271] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:07:59 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:00.217166 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:08:00.217368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:08:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:08:01.027310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:01.028057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:01.035553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:01.035972 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:01.036758 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:01.037193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:01.172879 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:01.181622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:01.183132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:01.184321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-622fa5e9-53d6-4891-b72b-ba3fbaa9d7cb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.161458 Jun 03 09:08:01.185031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 135/272] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:01 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:02.204189 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:02.204806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:02.212167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:02.212804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:02.213678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:02.214401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:02.465049 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:02.474251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:02.476074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:02.477355 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58305705-78a0-4d16-a598-daed10c16db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.278487 Jun 03 09:08:02.477987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 138/273] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:02 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:03.496174 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:03.496961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:03.503839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:03.504538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:03.505308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:03.505760 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:03.733969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:03.747702 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:03.750657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:03.752153 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-289bd094-578b-4176-add5-a338e34f0120 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.260515 Jun 03 09:08:03.763739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 136/274] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:03 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:04.770973 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:04.771788 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:04.779216 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:04.779989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:04.790468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:04.791536 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:04.950651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:04.960204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:04.961728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:04.963429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-965b6b50-016d-4f79-b03f-087c2338a705 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.196660 Jun 03 09:08:04.964715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 139/275] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:04 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:05.982375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:05.982975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:05.990362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:05.990820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:05.991586 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:05.992051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:06.141666 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:06.150701 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:06.152372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:06.154165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0384adb2-ebb8-4f0f-80b0-c288532fff5e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.175571 Jun 03 09:08:06.155083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 137/276] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:05 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:07.173992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:07.175845 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:07.183016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:07.183444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:07.184577 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:07.185169 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:07.541257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-49b4c12c-9936-4b08-8a8d-06c8f51b9aa8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:07.547805 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49b4c12c-9936-4b08-8a8d-06c8f51b9aa8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:07.548457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49b4c12c-9936-4b08-8a8d-06c8f51b9aa8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:07.575680 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=80,nova_cell1:UPDATE=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:07.576916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:07.597360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:07.599365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:07.600847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a71ad49-6d21-4e97-beed-00130a6921cf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.431606 Jun 03 09:08:07.601991 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 140/277] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:07 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:07.618707 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-49b4c12c-9936-4b08-8a8d-06c8f51b9aa8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Going to try to stop instance {{(pid=117753) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 09:08:07.669866 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-49b4c12c-9936-4b08-8a8d-06c8f51b9aa8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action" status: 202 len: 0 microversion: 2.1 time: 0.132142 Jun 03 09:08:07.670830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 138/278] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:08:07 2022] POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:08:07.678669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:07.679288 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:07.685801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:07.686551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:07.687776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:07.688387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:07.899100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:07.907513 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-72055b89-abdf-4bbe-8ee6-13db91243040 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.232580 Jun 03 09:08:07.917608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 141/279] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:07 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:08.633333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:08.635019 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:08.642958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:08.643409 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:08.644212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:08.644896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:08.833087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:08.842578 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:08.844804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:08.846053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f7cb7cb4-e196-4266-bddd-d97c0b25b6c4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.222270 Jun 03 09:08:08.847060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 139/280] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:08 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:08.926078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:08.927303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:08.929923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:08.936617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:08.937293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:08.938162 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:08.938522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:09.122906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:09.134272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0bf9f4a4-db45-4b5c-8056-770b6366ab60 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.210940 Jun 03 09:08:09.134987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 142/281] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:08 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:09.865909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:09.866520 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:09.881656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:09.882114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:09.882913 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:09.883352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:10.145543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:10.161356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:10.164441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:10.165069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:10.171530 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:10.174066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-eb107bb9-2686-40c1-a1e6-cd5d6c333dbb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.312543 Jun 03 09:08:10.176282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 140/282] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:09 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:10.207567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:10.208798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:10.209840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:10.210524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:10.465583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:10.475947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8c08f2a1-2592-4373-8629-b1140a5a83e0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.321846 Jun 03 09:08:10.477094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 143/283] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:10 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:08:11.197411 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:11.198719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:11.206108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:11.206848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:11.207830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:11.208451 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:11.366614 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:11.377560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:11.379096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:11.380355 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d3fe2b48-0c45-43fc-a9e1-3e13c42889da tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.188225 Jun 03 09:08:11.380927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 141/284] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:11 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:11.494949 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:11.495560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:11.504232 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:11.504917 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:11.506097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:11.506765 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:11.559020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4af8e807-f292-4cfd-88e0-e3a2aea9fad8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Action: 'create', calling method: .version_select at 0x7fd2b14a4ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-615997502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3aS1ODtZJeN9BdZXh6haRYD1/72+18sDGBZ5ISz4RNxgCVz6/V90BMSfUx2TLQO4pvNNNRowary9t8lh0D+pwmVQMT9lMACO3ozTlI4iRenkucBzpqnI8OIw8hSUYZYw=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:11.573274 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4af8e807-f292-4cfd-88e0-e3a2aea9fad8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for project c506ed29f8d94060bb8685604e8f3798. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:08:11.578960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4af8e807-f292-4cfd-88e0-e3a2aea9fad8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for user acbec87f607d4e00a2107c572fc68643 and project c506ed29f8d94060bb8685604e8f3798. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:08:11.608073 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4af8e807-f292-4cfd-88e0-e3a2aea9fad8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.274611 Jun 03 09:08:11.612541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 144/285] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:08:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:08:11.662381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:11.673178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ac63abf8-e713-4f29-82b1-e9995fbe577c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.181742 Jun 03 09:08:11.674619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 142/286] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:11 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:08:12.398720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:12.399969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:12.407125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:12.407548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:12.408603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:12.409138 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:12.572224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:12.582133 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:12.584358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:12.585710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-66044497-cb7a-42cc-9ee8-9b097918f6b3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.191043 Jun 03 09:08:12.586766 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 145/287] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:12 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:08:12.691559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:12.692225 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:12.694784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:12.700746 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:12.701569 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:12.702476 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:12.702959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:12.861065 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:12.869472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ebe70ec5-b7bb-4453-b013-3b68e4230053 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.182885 Jun 03 09:08:12.870131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 143/288] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:12 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:13.604733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:13.606042 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:13.616574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:13.617505 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:13.618516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:13.619185 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:13.635978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:13.789516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:13.805953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:13.808134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:13.810610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-86d2a6c8-b2b7-4c70-b6fd-79053ea3d84c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.209475 Jun 03 09:08:13.811253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 146/289] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:13 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:08:13.888297 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:13.888876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:13.895964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:13.896594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:13.897345 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:13.897768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:14.052926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:14.062887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4dfd6c18-a9d5-4366-9079-fb4bdf894d24 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.177780 Jun 03 09:08:14.063345 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 144/290] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:13 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:14.830364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:14.831042 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:14.839926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:14.840741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:14.841644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:14.842082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:14.995964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:15.004273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:15.005764 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:15.006902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19a1af6a-3c43-4979-8f29-ba9b0bc43b49 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.180569 Jun 03 09:08:15.007453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 147/291] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:14 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:08:15.080656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:15.081283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:15.088228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:15.088678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:15.089447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:15.089871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:15.230332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:15.238392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-481c3675-792e-4c4c-a13b-adb6523ec007 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.161971 Jun 03 09:08:15.238952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 145/292] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:15 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:16.025528 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:16.026131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:16.032878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:16.033363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:16.034622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:16.035059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:16.175464 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:16.183692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:16.185219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:16.186400 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c82d2b4-63ad-4661-898d-711cee36abc1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.164756 Jun 03 09:08:16.186945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 148/293] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:16 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:16.254829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:16.255434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:16.267592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:16.268410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:16.268902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:16.269375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:16.407319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:16.416884 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ea41b53e-cc38-4abc-8f72-9cb36b45d765 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.166061 Jun 03 09:08:16.417463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 146/294] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:16 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:17.205213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:17.205817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:17.213500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:17.213941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:17.215077 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:17.215541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:17.352995 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:17.360830 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:17.362317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:17.364078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4f3ed3c9-78fc-4e90-8c96-d5f24337990a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.162705 Jun 03 09:08:17.364630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 149/295] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:17 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:17.433844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:17.434463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:17.441185 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:17.441622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:17.442374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:17.442808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:17.574994 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:17.583254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0dc707f5-0028-48f2-8bc2-b26d978272e2 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1723 microversion: 2.1 time: 0.153174 Jun 03 09:08:17.583864 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 147/296] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:17 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:18.383656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:18.384181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:18.390830 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.391276 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.392087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.392524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.527978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:18.535910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:18.537409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:18.538926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c36f73e1-95ca-402a-886f-b0df4cd13e33 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.160159 Jun 03 09:08:18.539491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 150/297] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:18 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:18.602952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:18.603482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:18.610361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.610808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.611614 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.612080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.745631 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:18.753574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ffe9a7c7-43ce-485c-987e-3aacb99f248c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1700 microversion: 2.1 time: 0.155355 Jun 03 09:08:18.754141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 148/298] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:18 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:18.770432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88bf8d9b-b77f-4e40-a3bd-ac0e4576e228 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:18.776582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88bf8d9b-b77f-4e40-a3bd-ac0e4576e228 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.777038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88bf8d9b-b77f-4e40-a3bd-ac0e4576e228 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.839719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88bf8d9b-b77f-4e40-a3bd-ac0e4576e228 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Going to try to start instance {{(pid=117754) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 09:08:18.885722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88bf8d9b-b77f-4e40-a3bd-ac0e4576e228 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action" status: 202 len: 0 microversion: 2.1 time: 0.118705 Jun 03 09:08:18.886673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 151/299] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:08:18 2022] POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 09:08:18.895737 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:18.896387 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:18.908839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.909289 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:18.910047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:18.913544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:19.055124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:19.063876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c4456666-fc44-4f23-a916-25d709a2b849 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1709 microversion: 2.1 time: 0.172856 Jun 03 09:08:19.064454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 149/300] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:18 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:19.558086 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:19.558993 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:19.565554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:19.566239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:19.567049 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:19.567481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:19.704732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-56ffd894-64d7-47a8-8431-ab3af30e34c7 req-25ba6788-7089-49ed-a080-687e7361fdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "name": "network-vif-plugged", "status": "completed", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:19.709107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:19.715331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-56ffd894-64d7-47a8-8431-ab3af30e34c7 req-25ba6788-7089-49ed-a080-687e7361fdc5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:19.716042 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-56ffd894-64d7-47a8-8431-ab3af30e34c7 req-25ba6788-7089-49ed-a080-687e7361fdc5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:19.718696 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:19.720528 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:19.721949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6ba73d00-888a-4ea8-9f30-24332c77c133 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.168604 Jun 03 09:08:19.730482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-56ffd894-64d7-47a8-8431-ab3af30e34c7 req-25ba6788-7089-49ed-a080-687e7361fdc5 service nova] Creating event network-vif-plugged:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:08:19.735587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-56ffd894-64d7-47a8-8431-ab3af30e34c7 req-25ba6788-7089-49ed-a080-687e7361fdc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Jun 03 09:08:19.736371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 150/301] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:08:19.737076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 152/302] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:19 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:20.081526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:20.082257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:20.088525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:20.088974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:20.089736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:20.090173 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:20.223713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:20.242682 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3a47efe4-a0b9-4b99-9144-a5a0568fdedf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1709 microversion: 2.1 time: 0.165285 Jun 03 09:08:20.243182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 151/303] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:20 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:20.741457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:20.742191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:20.749156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:20.749586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:20.750341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:20.750768 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:20.884597 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:20.892839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:20.894453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:20.896045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-46d9fc34-2757-4605-bca5-5f9eb1395e1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.158593 Jun 03 09:08:20.896600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 153/304] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:20 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:21.261288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:21.261944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:21.269539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:21.269986 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:21.271334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:21.273926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:21.401968 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:21.409863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dbca4eda-1476-403f-92ce-5606ab9e87d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1713 microversion: 2.1 time: 0.153416 Jun 03 09:08:21.410420 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 152/305] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:21 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:21.914935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:21.915578 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:21.917498 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:21.923703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:21.924189 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:21.924940 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:21.925373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:22.070593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:22.080228 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:22.081999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:22.083383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-61539302-4116-430c-9503-215b7f86053b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.173324 Jun 03 09:08:22.088229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 154/306] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:21 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:23.101625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:23.102235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:23.108974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:23.109432 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:23.110197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:23.110780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:23.245229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:23.253376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:23.255398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:23.256569 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ed12ff02-bff6-44ba-971d-d38820406ebd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.158842 Jun 03 09:08:23.257113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 153/307] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:23 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:24.275010 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:24.275530 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:24.282014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:24.282460 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:24.283218 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:24.283648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:24.410372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:24.419003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:24.420553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:24.421703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dc156ab8-8a1a-49c5-8863-a0a42b80a261 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.150777 Jun 03 09:08:24.422258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 155/308] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:24 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:25.442239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:25.443211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:25.450503 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:25.450961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:25.451793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:25.452236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:25.467774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:25.609329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:25.618584 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:25.620123 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:25.621324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-68d3d9c4-a744-4565-b8da-4a1036f3beb0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.183488 Jun 03 09:08:25.621889 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 154/309] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:25 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:26.644826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:26.645472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:26.652287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:26.652734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:26.653519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:26.654065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:26.814109 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:26.823481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:26.825075 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:26.826251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ed014304-c3fa-45a6-be2a-91945e33a204 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1742 microversion: 2.20 time: 0.185772 Jun 03 09:08:26.834879 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 156/310] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:26 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:27.850906 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:27.852905 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:27.868825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:27.869666 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:27.870715 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:27.871392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:28.052011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:28.061665 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:28.065009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:28.066386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d7c42a13-7bf2-4d03-9a45-b2a3a0a7f575 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.220059 Jun 03 09:08:28.067703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 155/311] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:27 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:29.087310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:29.088042 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:29.095364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:29.096151 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:29.097267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:29.098114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:29.284338 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:29.300970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:29.304194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:29.306820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-26b9ff6d-40c0-4756-8d3f-0f57b6390f71 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.223816 Jun 03 09:08:29.313754 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 157/312] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:29 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:30.329112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:30.331021 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:30.340063 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:30.340809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:30.341938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:30.342789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:30.544236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:30.555542 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:30.557154 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:30.558354 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3978af66-fdef-4191-be39-9cbcd00baa5d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.235541 Jun 03 09:08:30.559197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 156/313] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:30 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:08:31.578296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:31.580089 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:31.586707 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:31.587157 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:31.587947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:31.588594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:31.755380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:31.764433 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:31.766264 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:31.767426 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d0ca251e-aa82-4594-92a3-05acb870bb15 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.193513 Jun 03 09:08:31.768009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 158/314] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:31 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:32.787227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:32.789471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:32.794184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:32.794625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:32.795407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:32.795864 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:32.950730 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:32.961493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:32.963598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:32.965128 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e6f6c941-0099-4d45-beec-f0c9b8527fe5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.183863 Jun 03 09:08:32.969802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 157/315] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:32 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:08:33.983697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:33.984325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:33.991523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:33.991644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:33.992916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:33.993353 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:34.161496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:34.171856 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:34.173490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:34.174735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c18bfa6e-f3af-4f94-95a4-5f3d79be5aed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.194922 Jun 03 09:08:34.175380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 159/316] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:33 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:35.195382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:35.196116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:35.203748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:35.204227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:35.205394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:35.206060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:35.353607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:35.381794 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:35.384227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:35.385444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-79966c30-753b-435d-88e5-acaca9be3b46 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.195078 Jun 03 09:08:35.386001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 158/317] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:35 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:36.404658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:36.405322 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:36.412129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:36.412580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:36.413610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:36.414044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:36.593569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:36.609377 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:36.612470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:36.615425 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9b6d6e2-b02d-48ac-846c-7419570e5e92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.214687 Jun 03 09:08:36.616493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 160/318] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:36 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:37.611382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1177592959", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615997502", "security_groups": [{"name": "tempest-secgroup-smoke-2001127604"}], "block_device_mapping_v2": [{"uuid": "5c199f85-4ffa-499e-a509-89c48d8e5085", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db505cc9-4748-4bbb-a7a3-c41105ee8dab"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:37.640063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:37.640855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:37.648810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:37.649616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:37.650632 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:37.651284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:37.886984 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] validate_networks() for [('db505cc9-4748-4bbb-a7a3-c41105ee8dab', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:08:38.071483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:38.088711 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:38.093129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:38.095974 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c54230e-bd13-4f73-9280-672f44ef39ff tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.464492 Jun 03 09:08:38.115798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 161/319] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:37 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:38.520600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:08:38.521713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:08:38.522812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:08:38.524077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:08:38.525074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:08:38.536624 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:38.537049 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:38.538368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:38.538821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:38.561290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:08:38.567979 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for user acbec87f607d4e00a2107c572fc68643 and project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:08:38.647792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:08:38.649924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c199f85-4ffa-499e-a509-89c48d8e5085',volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:08:38.833281 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-75b26333-3c67-47d5-a886-6e175b7f3cad tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.224804 Jun 03 09:08:38.834699 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 159/320] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:08:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 09:08:38.848735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2cca1b60-303e-441c-95dd-1b0ff15769b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:38.850618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2cca1b60-303e-441c-95dd-1b0ff15769b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:38.960003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2cca1b60-303e-441c-95dd-1b0ff15769b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:38.975626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2cca1b60-303e-441c-95dd-1b0ff15769b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1094 microversion: 2.1 time: 0.134110 Jun 03 09:08:38.977890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 162/321] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:38 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:39.130360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:39.131283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:39.141685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:39.142552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:39.146755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:39.147216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:39.399459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:39.418816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:39.422966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:39.424276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0ce8e7a6-25a1-4aed-8828-faf880c1b7d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.301031 Jun 03 09:08:39.425814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 160/322] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:39 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:39.996510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:39.998602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:40.002380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:40.013516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:40.014067 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:40.014933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:40.015631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:40.021342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:40.093493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:40.108203 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-14998a31-38ed-4fd7-88f0-d2e66c870f87 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1192 microversion: 2.1 time: 0.117374 Jun 03 09:08:40.108793 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 163/323] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:39 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1192 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:40.453826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:40.454448 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:40.462992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:40.463514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:40.464902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:40.465657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:40.655277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:40.666914 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:40.668494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:40.669691 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-923a49af-99c9-48e7-9e0c-f669a790a509 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.220144 Jun 03 09:08:40.670245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 161/324] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:40 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:41.131193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:41.137116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:41.148814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:41.152488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:41.153678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:41.155153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:41.241931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:41.255098 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-926fb2a9-2da3-4b71-add2-14f8cf3d8c18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1210 microversion: 2.1 time: 0.130343 Jun 03 09:08:41.256119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 164/325] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:41 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:41.692662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:41.693574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:41.700642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:41.701094 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:41.701875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:41.702311 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:42.095669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:42.104755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:42.106269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:42.107495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-52bbe8f8-dc73-4d4c-bffa-07ade7e7ef1a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1737 microversion: 2.20 time: 0.419632 Jun 03 09:08:42.108084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 162/326] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:41 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:42.276383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:42.277502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:42.290346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:42.291109 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:42.292600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:42.293434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:42.527785 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-1fa452cb-d9f7-48a4-8038-761b1e5989f0 req-36ca1051-0c05-40ab-9833-307f699b9edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca", "tag": "c69651d2-25f9-4aec-a409-cab23b429adc"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:42.565894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1fa452cb-d9f7-48a4-8038-761b1e5989f0 req-36ca1051-0c05-40ab-9833-307f699b9edb service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:42.570052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1fa452cb-d9f7-48a4-8038-761b1e5989f0 req-36ca1051-0c05-40ab-9833-307f699b9edb service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:42.572805 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:42.584810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7777cdc2-d999-479f-9c5b-e8da2772ff68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.315500 Jun 03 09:08:42.586713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-1fa452cb-d9f7-48a4-8038-761b1e5989f0 req-36ca1051-0c05-40ab-9833-307f699b9edb service nova] Creating event network-changed:c69651d2-25f9-4aec-a409-cab23b429adc for instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca on hv-cinder-81268 Jun 03 09:08:42.588393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 165/327] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:42 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:42.592645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-1fa452cb-d9f7-48a4-8038-761b1e5989f0 req-36ca1051-0c05-40ab-9833-307f699b9edb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071744 Jun 03 09:08:42.593244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 163/328] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:08:43.130411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:43.131234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:43.137624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:43.138064 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:43.138844 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:43.139273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:43.277735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:43.286834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:43.288644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:43.289816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3f75733c-5c4c-4658-95e7-a38895fc75a6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1719 microversion: 2.20 time: 0.166827 Jun 03 09:08:43.290379 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 166/329] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:43 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:43.603201 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:43.604012 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:43.606429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:43.612229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:43.612785 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:43.613513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:43.613952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:43.764838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:43.772898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-612e6b1d-dba4-4e11-91d1-f233f6adb500 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.173760 Jun 03 09:08:43.773483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 164/330] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:43 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:44.310426 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:44.311025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:44.317655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:44.318115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:44.318893 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:44.319317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:44.463043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:44.471551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:44.473709 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:44.474901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-937c577d-e989-41b2-862c-50093b23cc04 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1719 microversion: 2.20 time: 0.168422 Jun 03 09:08:44.475456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 167/331] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:44 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:44.790442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:44.791064 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:44.798130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:44.798579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:44.799431 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:44.800071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:44.944661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:44.953373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a4465d10-7e17-4c44-ab29-444dd546ba34 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.167083 Jun 03 09:08:44.953951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 165/332] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:44 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:45.493914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:45.494527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:45.501401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:45.501841 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:45.502609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:45.503041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:45.638367 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:45.646579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:45.648097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:45.649240 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-549bb997-59dd-4c71-bb32-05e36b72a3d8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1719 microversion: 2.20 time: 0.159255 Jun 03 09:08:45.649791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 168/333] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:45 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:45.793436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-a215c6b7-83eb-4785-8a8e-90c1b81c6fc5 req-dfb64e0d-76c0-4944-b651-8df39a3a908c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "name": "network-vif-unplugged", "status": "completed", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:45.805135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-a215c6b7-83eb-4785-8a8e-90c1b81c6fc5 req-dfb64e0d-76c0-4944-b651-8df39a3a908c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:45.806245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-a215c6b7-83eb-4785-8a8e-90c1b81c6fc5 req-dfb64e0d-76c0-4944-b651-8df39a3a908c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:45.820391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-a215c6b7-83eb-4785-8a8e-90c1b81c6fc5 req-dfb64e0d-76c0-4944-b651-8df39a3a908c service nova] Creating event network-vif-unplugged:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:08:45.825790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-a215c6b7-83eb-4785-8a8e-90c1b81c6fc5 req-dfb64e0d-76c0-4944-b651-8df39a3a908c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036149 Jun 03 09:08:45.826814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 166/334] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:08:45.971039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:45.972132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:45.979045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:45.979492 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:45.980309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:45.980907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:46.132478 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:46.140238 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b85e5ff6-4540-4b77-8b82-f45069f3eef3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.173533 Jun 03 09:08:46.140819 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 169/335] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:45 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:46.674692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:46.675792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:46.685147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:46.685596 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:46.686384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:46.686825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:46.839793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:46.848462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:46.849980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:46.851149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-40d31aa9-0a23-4634-bf8c-beb4a65ee279 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1662 microversion: 2.20 time: 0.185851 Jun 03 09:08:46.851725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 167/336] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:46 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:46.870882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd25f775-26c0-4222-ba2b-b9d4bb8fe5e2"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:46.872261 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:46.882120 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:46.882638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:46.883947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:46.884504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.161872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:47.162653 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:47.169793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.170553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.171579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.172230 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.277858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6153fe7b-a7d4-45d7-b631-9b2253d98fb5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.411830 Jun 03 09:08:47.278965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 170/337] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jun 3 09:08:46 2022] POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments => generated 188 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:08:47.330568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:47.338353 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4c54f8fe-fdc6-4cce-b26a-150f36082949 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.183612 Jun 03 09:08:47.338958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 168/338] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:47 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:47.406940 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:47.407514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:47.424135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.424581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.425550 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.425980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.518958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e3e89fe8-3e14-4f81-9f24-f952713344b5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/action" status: 202 len: 0 microversion: 2.20 time: 0.116269 Jun 03 09:08:47.520101 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 171/339] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 09:08:47 2022] POST /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:08:47.528424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:47.529033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:47.535257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.536272 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.537052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:47.537487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:47.673372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:47.683536 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:47.685129 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:47.686345 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-edff5b1e-df73-42fe-a2cb-0a050ac5e5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1748 microversion: 2.20 time: 0.161910 Jun 03 09:08:47.686905 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 169/340] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:47 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:48.355926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:48.356936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:48.365434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:48.365880 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:48.366658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:48.367097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:48.518339 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:48.526168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9b48da9c-bdcc-47d6-9e2c-4bfedff99f4f tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.175433 Jun 03 09:08:48.526754 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 172/341] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:48 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:48.718909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:48.720057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:48.724014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:48.724789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:48.734040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:48.734835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:48.737454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:48.737454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:48.879461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:48.888173 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:48.889678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:48.890848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e15d9a38-4eb6-4327-8e31-6ba297f25f8f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1750 microversion: 2.20 time: 0.179047 Jun 03 09:08:48.891399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 170/342] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:48 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:49.542847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:49.543406 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:49.545272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:49.551316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:49.551775 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:49.552548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:49.552986 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:49.688532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:49.696812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-063a142a-4d49-46a9-af98-a90b71b6d414 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.157902 Jun 03 09:08:49.697393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 173/343] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:49 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:49.910599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:49.911151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:49.917807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:49.918245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:49.918987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:49.919415 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:50.054668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:50.063337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:50.064864 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:50.066010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5fcea728-1657-4a6e-8f15-0cc405eba7e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1750 microversion: 2.20 time: 0.159418 Jun 03 09:08:50.066648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 171/344] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:49 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:50.714063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:50.714602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:50.721268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:50.721716 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:50.722480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:50.723464 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:50.856387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:50.864483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b47bc3ac-a7f3-47ce-9a35-1109441641da tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.154534 Jun 03 09:08:50.865044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 174/345] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:50 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:51.084268 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:51.084877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:51.091603 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:51.092105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:51.092873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:51.093313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:51.227849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:51.238013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:51.239661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:51.240804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8f458df9-630f-4858-8d89-d25ed28d41c8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.160413 Jun 03 09:08:51.241332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 172/346] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:51 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:51.881288 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:51.881886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:51.888430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:51.888873 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:51.889821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:51.890554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:52.061008 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:52.072943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-84f27982-8115-4801-aad2-a5b409fbeb3d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.195797 Jun 03 09:08:52.074846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 175/347] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:51 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:52.259040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:52.260285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:52.267368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:52.267958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:52.268723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:52.269150 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:52.272428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:52.426975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:52.435649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:52.437512 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:52.438903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9b1f4b27-12e2-48d6-9d3b-9f1a784715f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.183773 Jun 03 09:08:52.450640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 173/348] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:52 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:53.091704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:53.092454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:53.099870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:53.100457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:53.101193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:53.101724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:53.104726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:53.250008 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:53.257416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6f8f2890-709c-4efd-b39d-004d99c89c9c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.169607 Jun 03 09:08:53.257979 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 176/349] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:53 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:53.457992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:53.458742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:53.465929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:53.466385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:53.467148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:53.467631 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:53.609749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:53.618646 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:53.620186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:53.621482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c76970a0-4e55-493a-84aa-c0180ff54313 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.167827 Jun 03 09:08:53.621933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 174/350] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:53 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:53.878194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-853db4d3-cb1c-4898-ba52-ca13207e5211 req-d90fb66a-2450-4496-a496-af158e1e39e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca", "name": "network-vif-plugged", "status": "completed", "tag": "c69651d2-25f9-4aec-a409-cab23b429adc"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:08:53.889905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-853db4d3-cb1c-4898-ba52-ca13207e5211 req-d90fb66a-2450-4496-a496-af158e1e39e4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:53.891150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-853db4d3-cb1c-4898-ba52-ca13207e5211 req-d90fb66a-2450-4496-a496-af158e1e39e4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:53.907026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-853db4d3-cb1c-4898-ba52-ca13207e5211 req-d90fb66a-2450-4496-a496-af158e1e39e4 service nova] Creating event network-vif-plugged:c69651d2-25f9-4aec-a409-cab23b429adc for instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca on hv-cinder-81268 Jun 03 09:08:53.913049 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-853db4d3-cb1c-4898-ba52-ca13207e5211 req-d90fb66a-2450-4496-a496-af158e1e39e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039066 Jun 03 09:08:53.914265 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 177/351] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:08:54.273501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:54.274930 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:54.282978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:54.283633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:54.284607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:54.285149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:54.431897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:54.439588 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-338af7d2-f72a-480f-b3f1-b01fd11fc39b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.170077 Jun 03 09:08:54.440202 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 175/352] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:54 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:08:54.640396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:54.641967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:54.649717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:54.650541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:54.651381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:54.651924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:54.792912 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:54.802518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:54.804562 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:54.805812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-596df72c-c947-40b5-b05e-f527e663c2c2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.170595 Jun 03 09:08:54.806553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 178/353] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:54 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:55.458640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:55.459657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:55.467016 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:55.467461 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:55.468358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:55.468713 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:55.607124 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:55.615615 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c412400a-b853-4518-b95b-9b4d034aaf5e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.161987 Jun 03 09:08:55.616311 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 176/354] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:55 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:55.824898 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:55.825556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:55.831555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:55.832081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:55.832845 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:55.833280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:55.973024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:55.982459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:55.983996 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:55.990855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5a2cc938-f3e4-4eb6-9fe4-a7be3bea5752 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.169995 Jun 03 09:08:55.998330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 179/355] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:55 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:56.633843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:56.634564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:56.641630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:56.642140 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:56.642960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:56.643397 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:56.810723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:56.819779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-28cd444a-7f40-4ac1-866e-7dd8e3d822ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.190471 Jun 03 09:08:56.820358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 177/356] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:56 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:57.010462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:57.011875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:57.018160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:57.018600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:57.020192 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:57.020803 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:57.165024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:57.180382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:57.184165 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:57.186477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c3240e87-458a-467c-9b82-cc88fb4194a2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.179877 Jun 03 09:08:57.188903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 180/357] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:57 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:57.836459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:57.837087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:57.844080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:57.844537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:57.845319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:57.845758 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:57.987651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:57.995744 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9ff5f1df-abde-4101-9486-fa36f7a3d3a4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.163011 Jun 03 09:08:57.996356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 178/358] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:57 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:58.211990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:58.212563 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:58.219140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:58.219587 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:58.220383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:58.220817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:58.364315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:58.374542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:58.376079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:58.377253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cfee2c9-8161-4317-bbc4-70abdd3d7c38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.169309 Jun 03 09:08:58.377811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 181/359] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:58 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:08:59.013020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:59.013776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:59.021258 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:59.022160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:59.023036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:59.023564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:59.167499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:59.175341 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-297fbf60-c0d4-4d21-9dd4-e044a4334f2b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.166515 Jun 03 09:08:59.176646 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 179/360] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:08:59 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:08:59.399663 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:08:59.400446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:08:59.407618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:59.408109 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:59.408915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:08:59.409353 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:08:59.553214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:59.563659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:59.565216 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:08:59.566427 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8601bfd3-6f34-4bc4-93eb-99f7331b77f5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.170856 Jun 03 09:08:59.566992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 182/361] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:08:59 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:00.194197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:00.195849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:00.202690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:00.203649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:00.204559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:00.205231 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:00.343475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:00.350872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c0835f43-2046-4cdf-ae73-4a4a1cb80121 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.161788 Jun 03 09:09:00.351428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 180/362] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:00 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:00.585560 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:00.586187 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:00.592659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:00.593108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:00.593873 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:00.594306 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:00.731079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:00.740107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:00.741614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:00.742755 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-782a74a7-0463-4e16-9153-e40b849305e3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.161091 Jun 03 09:09:00.743314 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 183/363] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:00 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:01.367156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:01.368010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:01.375400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:01.375931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:01.376771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:01.377201 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:01.513096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:01.523592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a9fc78ac-3724-4b31-93c8-89edb718876c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.160740 Jun 03 09:09:01.524769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 181/364] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:01 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:01.761014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:01.761623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:01.768081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:01.768526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:01.769373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:01.769780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:01.926114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:01.934515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:01.936053 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:01.937184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d0d42ab-1aab-4630-ae6f-2057dc2de517 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.180257 Jun 03 09:09:01.937744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 184/365] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:01 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:09:02.542789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:02.543931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:02.552403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:02.553197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:02.554585 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:02.555029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:02.715681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:02.725690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2846094c-49c7-4942-ad58-ce3fae9ddc6c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.188557 Jun 03 09:09:02.726367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 182/366] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:02 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:02.955958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:02.956594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:02.963792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:02.964197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:02.964966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:02.965402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:03.097523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:03.107150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:03.108706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:03.110432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df7bea75-02a2-436c-8bcd-e110bd5aff11 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.158098 Jun 03 09:09:03.121118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 185/367] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:02 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:03.743030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:03.743659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:03.750001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:03.750439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:03.751189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:03.751623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:03.888816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:03.899123 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-52113feb-4dd3-46aa-a215-17da4c4c8621 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.159831 Jun 03 09:09:03.899712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 183/368] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:03 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:04.129838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:04.131093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:04.138450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:04.139153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:04.140110 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:04.140692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:04.284282 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:04.293067 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:04.294574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:04.295734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-56850ac1-f7bd-43bc-99f9-0f3d55387546 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.169758 Jun 03 09:09:04.296331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 186/369] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:04 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:04.915549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:04.916200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:04.922671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:04.923120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:04.923917 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:04.924357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:05.056792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:05.064319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2794bad5-88ed-45c4-b4f1-33e753f157fc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.152908 Jun 03 09:09:05.064971 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 184/370] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:04 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:05.313841 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:05.314434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:05.321013 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:05.321467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:05.322224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:05.322658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:05.452831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:05.461725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:05.463233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:05.464412 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-31a16b81-daa4-49cf-a7de-25187ca67de4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.154469 Jun 03 09:09:05.464974 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 187/371] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:05 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:06.082875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:06.083484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:06.090114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:06.090592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:06.091375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:06.091873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:06.220975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:06.228426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6823cca4-dc05-4333-8109-da13de98572a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.150930 Jun 03 09:09:06.228995 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 185/372] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:06 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:06.482318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:06.482923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:06.489914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:06.490360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:06.491112 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:06.491545 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:06.621119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:06.629508 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:06.631074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:06.632252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-85726370-e082-4aae-ae8e-b7bb79672a90 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.153812 Jun 03 09:09:06.632808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 188/373] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:06 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:07.244963 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:07.245574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:07.252198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:07.252648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:07.253897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:07.254332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:07.383374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:07.390840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4ae73c10-be68-444c-bf53-0484ff359b05 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.149725 Jun 03 09:09:07.391405 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 186/374] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:07 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:07.650184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:07.650785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:07.657256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:07.657692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:07.658442 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:07.658869 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:07.786972 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:07.795781 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:07.797341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:07.798697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-68090cc0-91c7-4389-9dc8-b5bc604fa3ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.152357 Jun 03 09:09:07.799620 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 189/375] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:07 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:08.407598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:08.408233 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:08.415499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:08.415988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:08.416751 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:08.417193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:08.553950 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:08.563970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5559ebed-b024-4c72-bca1-1870c4e9ae2d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.159699 Jun 03 09:09:08.564998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 187/376] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:08 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:08.819103 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:08.819699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:08.826247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:08.826685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:08.827436 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:08.827909 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:08.955644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:08.964146 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:08.965639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:08.966792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c4f33640-9a2e-4afd-89b9-0d637c6dd23b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.152264 Jun 03 09:09:08.967347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 190/377] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:08 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:09.581313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:09.581901 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:09.589133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:09.589579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:09.590347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:09.590781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:09.729326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:09.737102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-77c33725-0a11-4906-b1db-ab5fb930a113 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.159730 Jun 03 09:09:09.737671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 188/378] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:09 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:09.984904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:09.985425 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:09.992097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:09.992548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:09.993314 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:09.993751 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:10.121017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:10.129894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:10.131459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:10.132644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4b4b4bf9-6b54-4f68-918c-6596d470c2cd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.151712 Jun 03 09:09:10.133209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 191/379] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:09 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:09:10.753716 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:10.754740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:10.761337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:10.761785 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:10.762544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:10.762977 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:10.903616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:10.906143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:10.913247 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-47b96140-f2d3-4d3f-8ae0-4a1f1276fd23 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1266 microversion: 2.1 time: 0.163435 Jun 03 09:09:10.913984 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 189/380] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:10 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:11.150350 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:11.150968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:11.153413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=60 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:11.158936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:11.159384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:11.160176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:11.160616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:11.286710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:11.295419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:11.296950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:11.298093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-157dcf62-41ba-4662-a49f-bb05b166744b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.151603 Jun 03 09:09:11.298644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 192/381] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:11 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:11.930250 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:11.930871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:11.937282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:11.937723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:11.938509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:11.938935 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:12.072315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:12.079743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c36ac3ed-42bd-4a32-8de3-7181cda09282 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1453 microversion: 2.1 time: 0.153380 Jun 03 09:09:12.080329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 190/382] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:11 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:12.096748 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:12.097357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:12.103899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:12.104348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:12.105106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:12.105540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:12.119930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:12.237201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:12.244818 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3a92fd1-3dc2-4f90-9823-cbc56b59144c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1453 microversion: 2.1 time: 0.151798 Jun 03 09:09:12.245392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 193/383] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:12 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:12.316219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:12.316874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:12.323252 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:12.323692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:12.324508 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:12.325326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:12.457449 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:12.466841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:12.468474 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:12.469630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1aeb3479-6780-49c2-acd8-86fd91685188 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.157260 Jun 03 09:09:12.470183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 191/384] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:12 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:13.488035 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:13.488646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:13.495148 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:13.495599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:13.496401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:13.496837 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:13.629489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:13.638567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:13.640095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:13.641513 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb132108-1efa-4977-947c-cff99b86db6f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.157608 Jun 03 09:09:13.642081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 194/385] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:13 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:14.106864 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-d7fe4c03-f480-4707-9613-e89a229dcb1b req-b5e40f56-b80d-40d8-aea0-d6b1502deaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca", "tag": "c69651d2-25f9-4aec-a409-cab23b429adc"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:14.110760 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=56 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:14.117386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d7fe4c03-f480-4707-9613-e89a229dcb1b req-b5e40f56-b80d-40d8-aea0-d6b1502deaf8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:14.117888 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d7fe4c03-f480-4707-9613-e89a229dcb1b req-b5e40f56-b80d-40d8-aea0-d6b1502deaf8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:14.129247 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-d7fe4c03-f480-4707-9613-e89a229dcb1b req-b5e40f56-b80d-40d8-aea0-d6b1502deaf8 service nova] Creating event network-changed:c69651d2-25f9-4aec-a409-cab23b429adc for instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca on hv-cinder-81268 Jun 03 09:09:14.135219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-d7fe4c03-f480-4707-9613-e89a229dcb1b req-b5e40f56-b80d-40d8-aea0-d6b1502deaf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 Jun 03 09:09:14.135870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 192/386] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:09:14.660321 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:14.661283 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:14.668680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:14.669254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:14.670151 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:14.670843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:14.809168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:14.818518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:14.820212 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:14.821516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5dd4fd7b-c5dc-4d97-9825-0339f2d56723 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.165230 Jun 03 09:09:14.822153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 195/387] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:14 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:15.839961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:15.840649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:15.847271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:15.847706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:15.848481 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:15.848929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:15.976487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:15.985149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:15.986952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:15.988209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-41e8a769-a706-4914-8bf2-c96aac77ec83 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.152458 Jun 03 09:09:15.988979 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 193/388] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:15 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:17.006518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:17.007125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:17.013807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:17.014343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:17.015151 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:17.015585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:17.148646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:17.157065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:17.158569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:17.159710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ae11af6f-d952-4e2c-beda-c08015f7f32b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.157162 Jun 03 09:09:17.160293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 196/389] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:17 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:18.179048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:18.179652 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:18.186286 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:18.186735 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:18.187489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:18.187962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:18.327728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:18.336314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:18.337817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:18.338953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3b11e7a5-8259-4d2a-9a53-969ea128dc1e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.164481 Jun 03 09:09:18.339511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 194/390] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:18 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:19.357134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:19.357740 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:19.364340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:19.364785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:19.366054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:19.366494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:19.495359 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:19.503744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:19.505277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:19.507036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc2351ca-c543-4976-a312-491fbc93c8a1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.153846 Jun 03 09:09:19.507595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 197/391] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:19 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:19.962578 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-b2b62c1c-29d9-44ea-8679-4925bbac4c1e req-2ad30d3e-b5f2-4974-8df4-8f84dfa3f8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "name": "network-vif-plugged", "status": "completed", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:19.971654 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b2b62c1c-29d9-44ea-8679-4925bbac4c1e req-2ad30d3e-b5f2-4974-8df4-8f84dfa3f8a8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:19.972157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b2b62c1c-29d9-44ea-8679-4925bbac4c1e req-2ad30d3e-b5f2-4974-8df4-8f84dfa3f8a8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:19.983851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-b2b62c1c-29d9-44ea-8679-4925bbac4c1e req-2ad30d3e-b5f2-4974-8df4-8f84dfa3f8a8 service nova] Creating event network-vif-plugged:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:09:19.989215 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-b2b62c1c-29d9-44ea-8679-4925bbac4c1e req-2ad30d3e-b5f2-4974-8df4-8f84dfa3f8a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Jun 03 09:09:19.989811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 195/392] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:09:20.526437 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:20.527178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:20.533935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:20.534383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:20.535156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:20.535594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:20.666046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:20.674549 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:20.676069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:20.677216 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-000c93fd-3bc4-4a17-8815-45a16d32eff1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.154804 Jun 03 09:09:20.678382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 198/393] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:20 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:21.697375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:21.698066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:21.704357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:21.704802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:21.705557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:21.705991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:21.837271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:21.845567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:21.847036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:21.848200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f3de2588-6a58-4a04-9759-41d15e1fe190 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1806 microversion: 2.20 time: 0.156225 Jun 03 09:09:21.848752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 196/394] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:21 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:22.866473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:22.867065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:22.873543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:22.873978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:22.874726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:22.875156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:23.003557 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:23.012697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:23.014200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:23.015347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d8fc1d6e-e143-44a2-8b3e-2665b52399ec tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1793 microversion: 2.20 time: 0.152875 Jun 03 09:09:23.015922 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 199/395] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:09:22 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1793 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:09:41.137667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=9 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:41.138402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=35 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:41.241292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:41.241909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:41.248003 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:41.248491 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:41.249240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:41.249667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:41.497969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lazy-loading 'services' on Instance uuid 66adb02f-314e-4e7b-bd15-d3a2674cfd38 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:09:41.610677 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0970c1d0-9a40-4891-85f0-4f9ce8139515 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments/1565f6fb-a001-4cd3-a714-7615b8796a52" status: 202 len: 0 microversion: 2.1 time: 0.477637 Jun 03 09:09:41.611268 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 197/396] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:09:41 2022] DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments/1565f6fb-a001-4cd3-a714-7615b8796a52 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:09:42.727340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7f5cc402-6904-45c3-ad0e-bf817fb21fe7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:42.729813 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=15 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:42.730466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=39 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:42.736795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f5cc402-6904-45c3-ad0e-bf817fb21fe7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:42.737244 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f5cc402-6904-45c3-ad0e-bf817fb21fe7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:42.759544 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7f5cc402-6904-45c3-ad0e-bf817fb21fe7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Going to try to stop instance {{(pid=117754) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 09:09:42.802428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7f5cc402-6904-45c3-ad0e-bf817fb21fe7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action" status: 202 len: 0 microversion: 2.1 time: 0.079524 Jun 03 09:09:42.803200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 200/397] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:09:42 2022] POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:09:42.812071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:42.812771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:42.822427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:42.822871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:42.823644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:42.824143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:42.959293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:42.967886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8d22f63c-eb45-469d-aad9-d62cc8380b16 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.159992 Jun 03 09:09:42.968456 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 198/398] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:42 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:09:43.379567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "123dc552-8190-40a7-b2a4-e0239c9ceec8"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:43.380833 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:43.387676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:43.388159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:43.388925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:43.389360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:43.703383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6d03957e-8798-43f0-a38c-af28bd7e8d63 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329166 Jun 03 09:09:43.704060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 201/399] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:09:43 2022] POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:09:43.985287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:43.985810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:43.992403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:43.992850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:43.993601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:43.994033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:44.127200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:44.135280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-401fc332-3699-41f7-a984-306053c91bb9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.153903 Jun 03 09:09:44.135863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 199/400] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:43 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:45.154196 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:45.154889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:45.161794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:45.162491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:45.163248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:45.163682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:45.292482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:45.299984 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35561a18-cb99-451f-8d95-c2998fd7175f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.149978 Jun 03 09:09:45.300551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 202/401] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:45 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:46.317869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:46.318453 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:46.325840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:46.326398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:46.327150 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:46.327582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:46.460030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:46.467490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-655cb9ce-2d55-4954-aaed-ec140853da9a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.153461 Jun 03 09:09:46.468096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 200/402] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:46 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:47.484717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:47.485311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:47.491732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:47.492195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:47.492947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:47.493371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:47.618798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:47.626123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b79991bf-bb8c-43f5-9f83-44d794485dda tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.145270 Jun 03 09:09:47.626876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 203/403] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:47 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:09:48.643666 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:48.644278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:48.651364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:48.651840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:48.652606 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:48.653044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:48.793938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:48.801400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e1eb5f89-30e1-4157-a63f-b8e9f9e27343 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.161560 Jun 03 09:09:48.801968 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 201/404] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:48 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:49.817791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:49.818392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:49.825425 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:49.825874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:49.826625 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:49.827059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:49.960590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:49.968280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fa7cc976-3c82-4812-b173-9f4982fa73d8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.154238 Jun 03 09:09:49.968861 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 204/405] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:49 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:50.985398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:50.986002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:50.992672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:50.993121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:50.993951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:50.994364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:51.123102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:51.130822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-da1fd814-1c05-4aa8-a1c2-12734a29166f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.149335 Jun 03 09:09:51.131381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 202/406] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:50 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:51.191772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:51.192779 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:51.199672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:51.200152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:51.200910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:51.201414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:51.223955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'flavor' on Instance uuid c7d31771-42ff-473f-ac20-ac36676a108b {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:09:51.348861 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2f5d56c5-adb1-41ba-aa8c-9da6f79df16f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/action" status: 200 len: 32 microversion: 2.1 time: 0.160979 Jun 03 09:09:51.349428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 205/407] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:09:51 2022] POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:09:51.359487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:51.360040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:51.366599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:51.367208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:51.368113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:51.368603 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:51.503071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:51.511897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-25652ba2-688a-4650-b6ba-db609a6a57db tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.156988 Jun 03 09:09:51.512479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 203/408] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:51 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:52.149226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:52.149906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:52.156364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:52.156804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:52.157552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:52.157979 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:52.285361 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:52.294686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c9260297-6367-46ee-953a-1d1a6b2a2ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.150059 Jun 03 09:09:52.295270 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 206/409] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:52 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:52.373806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:09:52.374327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:09:52.529670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:52.530285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:52.537581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:52.538028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:52.538795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:52.539235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:52.669445 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:52.677639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-01c06779-dfbd-4e2e-9188-9d2d76512d70 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.151611 Jun 03 09:09:52.678267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 204/410] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:52 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:53.312300 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:53.313634 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:53.320371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:53.320827 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:53.321581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:53.322014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:53.454602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:53.462188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-35f2940f-3391-4a90-91f0-2c3b02bb29a5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.153814 Jun 03 09:09:53.462751 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 207/411] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:53 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:53.695524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:53.696169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:53.702712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:53.703180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:53.703969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:53.704407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:53.829908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:53.838413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-35381d3b-8ad7-4e5c-8b0a-819f837ea849 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.147891 Jun 03 09:09:53.838974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:53 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:54.478415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:54.479008 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:54.485780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:54.486299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:54.487003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:54.487448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:54.615650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:54.623579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-55571add-5124-4004-8624-808a88f5796c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.148992 Jun 03 09:09:54.624178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 208/413] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:54 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:54.854923 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:54.855500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:54.862050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:54.862488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:54.863236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:54.863660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:54.993417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:55.001422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0aa24e64-805a-4f25-8c54-1263bbfeefba tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.150913 Jun 03 09:09:55.001977 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 206/414] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:54 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:55.641503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:55.642279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:55.648858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:55.649302 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:55.650646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:55.651135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:55.780902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:55.788568 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-92ac4ec1-01cc-4f34-9255-e5153e00c475 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.151148 Jun 03 09:09:55.789127 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 209/415] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:55 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:56.018386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:56.019056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:56.025649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:56.026099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:56.026851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:56.027285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:56.158227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:56.166378 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3d298216-c7d1-4995-9b83-118eed6463e8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.151896 Jun 03 09:09:56.166931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 207/416] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:56 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:56.805557 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:56.806293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:56.813036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:56.813480 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:56.814232 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:56.814660 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:56.941797 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:56.949359 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-58bbeadf-b0e2-4056-9be8-42e36196e748 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.147693 Jun 03 09:09:56.950003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 210/417] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:56 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:57.183459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:57.184093 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:57.190611 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:57.191057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:57.191843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:57.192282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:57.322300 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:57.330236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7065d47a-b812-4a73-a2e4-106942bd0a41 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.150614 Jun 03 09:09:57.330796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 208/418] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:57 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:57.966451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:57.967062 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:57.973733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:57.974201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:57.974965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:57.975403 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:58.104122 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:58.112165 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-277c40ff-48c9-4651-a365-be968fcbcf15 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1677 microversion: 2.1 time: 0.149469 Jun 03 09:09:58.112742 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 211/419] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:57 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:58.348167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:58.348810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:58.357212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:58.357802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:58.358745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:58.359194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:58.505943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:58.514514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-51b953fb-1462-4378-8091-5cc8ab43ad6d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.170220 Jun 03 09:09:58.515082 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 209/420] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:58 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:59.128923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:59.129524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:59.136642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.137078 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.137826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.138255 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.142268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:59.268966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:59.276434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0ad52473-7ea9-4e55-aac0-758310a6f3a7 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1654 microversion: 2.1 time: 0.151396 Jun 03 09:09:59.277007 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 212/421] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:59 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:59.293173 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c8ba8553-7e97-4cf6-93d8-54e5dbba2a84 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:09:59.299258 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8ba8553-7e97-4cf6-93d8-54e5dbba2a84 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.299706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8ba8553-7e97-4cf6-93d8-54e5dbba2a84 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.321587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c8ba8553-7e97-4cf6-93d8-54e5dbba2a84 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Going to try to start instance {{(pid=117753) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 09:09:59.365178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c8ba8553-7e97-4cf6-93d8-54e5dbba2a84 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action" status: 202 len: 0 microversion: 2.1 time: 0.076078 Jun 03 09:09:59.365916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 210/422] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:09:59 2022] POST /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:09:59.374656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:59.375397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:59.381357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.381808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.382586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.383017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.515279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:59.522939 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-89cab108-2484-44e1-91ad-d05926c18a40 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1663 microversion: 2.1 time: 0.152180 Jun 03 09:09:59.523484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 213/423] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:59 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:09:59.531458 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:09:59.532468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:09:59.539014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.539454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.540238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:09:59.541188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:09:59.670888 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:09:59.674467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:59.679323 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-552be7cc-c31e-4574-9ddf-3edfb5a1ffa9 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.152139 Jun 03 09:09:59.679926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 211/424] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:09:59 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:00.540343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:00.541571 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:00.548270 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:00.548715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:00.549482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:00.549918 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:00.682791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:00.690282 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8ff3488c-1a24-497e-9fbf-01f8978e9742 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1667 microversion: 2.1 time: 0.154224 Jun 03 09:10:00.691050 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 214/425] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:00 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:00.699024 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:00.699663 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:00.707642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:00.708133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:00.708902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:00.709337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:01.078242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:01.086537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5fe5a536-a7b0-4b21-8c5b-cc2a87464677 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.392185 Jun 03 09:10:01.087100 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 212/426] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:00 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:02.104449 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:02.105045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:02.111475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:02.111967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:02.112722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:02.113152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:02.241070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:02.249047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e94b8062-99f3-4ae1-a85f-a31496452328 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.149105 Jun 03 09:10:02.249623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 215/427] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:02 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:03.266326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:03.266871 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:03.273805 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:03.274246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:03.275640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:03.276091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:03.413329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:03.421258 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-167e36ca-85ea-4940-b9d8-19b048b14005 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.158858 Jun 03 09:10:03.421863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 213/428] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:03 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:04.441978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:04.442585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:04.449143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:04.449665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:04.450328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:04.450752 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:04.579875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:04.588362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f3360009-2880-4656-be66-4bf441719887 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.150244 Jun 03 09:10:04.588929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:04 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:05.605957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:05.606551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:05.613092 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:05.613543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:05.614296 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:05.614728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:05.746155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:05.754129 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-260728d0-676f-408f-aa52-9fa7c91e123f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.152615 Jun 03 09:10:05.754692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 214/430] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:05 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:06.771038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:06.771568 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:06.778019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:06.778454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:06.779198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:06.779624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:06.908726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:06.916781 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-945d88b0-b11b-4771-adba-51f62afca88a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.149642 Jun 03 09:10:06.917346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 217/431] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:06 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:07.933833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:07.934443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:07.941030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:07.941479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:07.942239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:07.942677 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:08.068331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:08.076383 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3b75e917-476f-4dfa-a5fb-84d07ad79257 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.146415 Jun 03 09:10:08.076948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 215/432] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:07 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:09.093981 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:09.094853 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:09.101846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:09.102321 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:09.103597 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:09.104064 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:09.237690 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:09.246152 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-802e73b1-43f6-432f-baac-2c426e902e5e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.156437 Jun 03 09:10:09.246714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 218/433] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:09 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:10.263865 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:10.264406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:10.270970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:10.271415 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:10.272207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:10.272645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:10.399681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:10.407643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a643cc72-ed15-4300-8b24-5b757a831acb tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1735 microversion: 2.1 time: 0.148329 Jun 03 09:10:10.408239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 216/434] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:10 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:11.425025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:11.425654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:11.432145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.432588 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.433333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.433762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.563292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:11.571210 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1a4578ce-9fff-4a2d-8c4d-c7335d5ff953 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1715 microversion: 2.1 time: 0.150041 Jun 03 09:10:11.572311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 219/435] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:11 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:11.671776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:11.672290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:11.674564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=41 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:11.680186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.680572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.681853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.682284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.761756 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] HTTP exception thrown: Cannot 'detach_volume' instance c7d31771-42ff-473f-ac20-ac36676a108b while it is in vm_state rescued Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Request method failure captured: Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments/123dc552-8190-40a7-b2a4-e0239c9ceec8 HTTP/1.1 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc73ctoiRmLt8EVyZOLRx5b0zVVA3wygWU4BbNCjns6QQa8Z4_d_A-lBpi05iJXcmK9dViZwPIkV5ZD8VqhzLPMYYK__trQ7lwqlUBejjaZkk_inJQhlfsw8daDtZBzyKHjAaDNm7PkCujEEqDiFZrI-aBaimHcefyib54sTZtaDDR0 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:10:11.763769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 3d8fbafbd63c4e1c946b414e2842eb91 Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:10:11.765278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Cannot 'detach_volume' instance c7d31771-42ff-473f-ac20-ac36676a108b while it is in vm_state rescued Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'server_id': 'c7d31771-42ff-473f-ac20-ac36676a108b', 'id': '123dc552-8190-40a7-b2a4-e0239c9ceec8'} Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7d31771-42ff-473f-ac20-ac36676a108b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:10:11.765958 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c7d31771-42ff-473f-ac20-ac36676a108b while it is in vm_state rescued Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c7d31771-42ff-473f-ac20-ac36676a108b while it is in vm_state rescued Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:11.767192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Returning 409 to user: Cannot 'detach_volume' instance c7d31771-42ff-473f-ac20-ac36676a108b while it is in vm_state rescued {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:10:11.768295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a8c649f4-d2c8-4d4b-bd61-5a6e65789aa8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments/123dc552-8190-40a7-b2a4-e0239c9ceec8" status: 409 len: 152 microversion: 2.1 time: 0.097449 Jun 03 09:10:11.768295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 217/436] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:10:11 2022] DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments/123dc552-8190-40a7-b2a4-e0239c9ceec8 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 09:10:11.774090 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:11.775105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:11.781141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.781581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.782328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.782759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.847970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-593888ce-222f-4cf3-b7de-290dc3c56d07 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/action" status: 202 len: 0 microversion: 2.1 time: 0.077426 Jun 03 09:10:11.848579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 220/437] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:10:11 2022] POST /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:10:11.857196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:11.857811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:11.864803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.865249 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.866002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:11.866429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:11.997486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:12.005896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ad58f3a1-6b88-4d8c-9392-afef78e4f7b0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1723 microversion: 2.1 time: 0.153067 Jun 03 09:10:12.006469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 218/438] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:11 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:13.025336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:13.026040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:13.027990 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=43 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:13.034666 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:13.035119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:13.036040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:13.036479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:13.163365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:13.171416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ddc4c310-ceb3-4bc3-b055-312cc17424cc tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1723 microversion: 2.1 time: 0.151473 Jun 03 09:10:13.172020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 221/439] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:13 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:14.190040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:14.190648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:14.197293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:14.197739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:14.198516 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:14.198937 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:14.332309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:14.342393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-01f02a28-eca3-4029-9604-c6c9b76855f0 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1723 microversion: 2.1 time: 0.154983 Jun 03 09:10:14.342393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 219/440] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:14 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:15.358415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:15.359093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:15.365717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:15.366159 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:15.366917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:15.367346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:15.502899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:15.516985 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ec53f267-e3c1-4e63-a824-21288817800a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1723 microversion: 2.1 time: 0.162194 Jun 03 09:10:15.517882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 222/441] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:15 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:16.534493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:16.535095 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:16.542310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:16.542748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:16.543495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:16.543970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:16.675771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:16.685643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-08e96680-6a99-4ca5-83a3-599bbd49059f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1729 microversion: 2.1 time: 0.155001 Jun 03 09:10:16.686214 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 220/442] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:10:16 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:16.702039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:16.702571 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:16.708994 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:16.709435 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:16.710183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:16.710609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:16.784862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7f28e820-5930-4ec5-9742-f180530bbcd3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086628 Jun 03 09:10:16.785447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 223/443] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:10:16 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:17.644431 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-314d880a-686e-495e-8286-bf09977907a5 req-d0d17cef-a99c-4cae-a2a2-cb74939bb2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:17.653185 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-314d880a-686e-495e-8286-bf09977907a5 req-d0d17cef-a99c-4cae-a2a2-cb74939bb2d1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:17.653636 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-314d880a-686e-495e-8286-bf09977907a5 req-d0d17cef-a99c-4cae-a2a2-cb74939bb2d1 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:17.665572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-314d880a-686e-495e-8286-bf09977907a5 req-d0d17cef-a99c-4cae-a2a2-cb74939bb2d1 service nova] Creating event network-changed:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:10:17.671143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-314d880a-686e-495e-8286-bf09977907a5 req-d0d17cef-a99c-4cae-a2a2-cb74939bb2d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 Jun 03 09:10:17.671747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 221/444] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:19.686021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-0bbc11a2-61bf-4051-bbd4-9fae6fa09caa req-74671f6a-92fc-43fa-8ea8-04fd334b1a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:19.694395 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0bbc11a2-61bf-4051-bbd4-9fae6fa09caa req-74671f6a-92fc-43fa-8ea8-04fd334b1a09 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:19.694837 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-0bbc11a2-61bf-4051-bbd4-9fae6fa09caa req-74671f6a-92fc-43fa-8ea8-04fd334b1a09 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:19.712928 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-0bbc11a2-61bf-4051-bbd4-9fae6fa09caa req-74671f6a-92fc-43fa-8ea8-04fd334b1a09 service nova] Creating event network-changed:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:10:19.718258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-0bbc11a2-61bf-4051-bbd4-9fae6fa09caa req-74671f6a-92fc-43fa-8ea8-04fd334b1a09 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Jun 03 09:10:19.718856 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 224/445] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:30.282607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=9 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:30.283396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=56 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:30.407224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:30.408202 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:30.415196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.415782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.416810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.417298 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.449930 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b41f1d6b-266f-436e-96b4-833c0b160571 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments/cd25f775-26c0-4222-ba2b-b9d4bb8fe5e2" status: 200 len: 194 microversion: 2.20 time: 0.168918 Jun 03 09:10:30.450550 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 222/446] 10.222.0.61 () {60 vars in 1453 bytes} [Fri Jun 3 09:10:30 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments/cd25f775-26c0-4222-ba2b-b9d4bb8fe5e2 => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:10:30.526039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=7 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:30.526797 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:30.531955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:30.532573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:30.541016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.541468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.542249 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.542767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.678536 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lazy-loading 'services' on Instance uuid 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:10:30.837909 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7cad1f5-86c9-412c-aad9-2e8ef5b07290 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments/cd25f775-26c0-4222-ba2b-b9d4bb8fe5e2" status: 202 len: 0 microversion: 2.20 time: 0.309505 Jun 03 09:10:30.838583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 225/447] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jun 3 09:10:30 2022] DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments/cd25f775-26c0-4222-ba2b-b9d4bb8fe5e2 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:10:30.859468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:30.862325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:30.881742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.882260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.883846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:30.884230 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:30.942033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-90892969-73b4-4df5-8ff5-d7a4bc9425e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093038 Jun 03 09:10:30.942629 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 223/448] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 09:10:30 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:10:31.960734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:31.962395 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:31.973482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:31.974568 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:31.975619 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:31.976413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:32.024840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-da428093-6985-40c4-87f7-648c1d028ca3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072735 Jun 03 09:10:32.025789 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 226/449] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 09:10:31 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:10:32.104944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:32.105636 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:32.112361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:32.112814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:32.113596 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:32.114035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:32.153000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:10:32.278554 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-571cfee0-ed7a-409a-b14a-a5ab46e3b997 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 204 len: 0 microversion: 2.20 time: 0.178245 Jun 03 09:10:32.279077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 224/450] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 09:10:32 2022] DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 09:10:32.288538 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:32.289229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:32.296116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:32.296617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:32.297548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:32.298073 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:32.461891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:32.470240 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:32.471909 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:32.473130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82ff8323-45d9-494b-a2a3-a531cf60e701 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.189381 Jun 03 09:10:32.473724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 227/451] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:32 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:33.497053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:33.498075 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:33.507194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:33.507867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:33.508987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:33.509608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:33.666807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:33.675351 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:33.676876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:33.678068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-185bc092-dfab-47fa-993c-53b2bd169c78 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.187752 Jun 03 09:10:33.678622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 225/452] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:33 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:34.698268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:34.698886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:34.705918 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:34.706366 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:34.707143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:34.707574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:34.891987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:34.901280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:34.903947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:34.906382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3f054637-9fa3-4c54-aebc-156f0b8e9097 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1721 microversion: 2.20 time: 0.211947 Jun 03 09:10:34.907287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 228/453] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:34 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:35.940599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:35.943949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:35.990599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-1a852cfc-0f7e-47d3-a74b-bd843e588fbe req-af40cc5c-cb0d-45c4-8005-9ce940e41e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40730a5d-018c-47c2-96a7-2f2c6dcf1c67", "name": "network-vif-deleted", "tag": "20b11e03-c83b-48c3-9544-6445eb67003e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:35.997906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:35.998751 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:36.000277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:36.004119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:36.007160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1a852cfc-0f7e-47d3-a74b-bd843e588fbe req-af40cc5c-cb0d-45c4-8005-9ce940e41e53 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:36.007601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1a852cfc-0f7e-47d3-a74b-bd843e588fbe req-af40cc5c-cb0d-45c4-8005-9ce940e41e53 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:36.038792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-1a852cfc-0f7e-47d3-a74b-bd843e588fbe req-af40cc5c-cb0d-45c4-8005-9ce940e41e53 service nova] Creating event network-vif-deleted:20b11e03-c83b-48c3-9544-6445eb67003e for instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 on hv-cinder-81268 Jun 03 09:10:36.049564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-1a852cfc-0f7e-47d3-a74b-bd843e588fbe req-af40cc5c-cb0d-45c4-8005-9ce940e41e53 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176732 Jun 03 09:10:36.050494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 226/454] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:36.139474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:36.157912 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:36.160927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:36.163861 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ac319768-88ac-496c-9c65-d260a4da2ff6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 200 len: 1366 microversion: 2.20 time: 0.239837 Jun 03 09:10:36.166119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 229/455] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:35 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:37.185585 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:37.186412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:37.192853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:37.193298 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:37.194300 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:37.194738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:37.210833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 HTTP/1.1 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:10:37.213139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:10:37.216047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '40730a5d-018c-47c2-96a7-2f2c6dcf1c67'} Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:10:37.218158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:10:37.222697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:10:37.225698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:10:37.225698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf324fd1-1a32-43af-8527-58690ba160e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 404 len: 111 microversion: 2.20 time: 0.036084 Jun 03 09:10:37.225698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 227/456] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:37 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:10:37.232626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-be64746c-002f-473f-9fe9-0ef446e548db tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '.version_select at 0x7fd2b13780d0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:37.265624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-be64746c-002f-473f-9fe9-0ef446e548db tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552544705" status: 204 len: 0 microversion: 2.20 time: 0.039816 Jun 03 09:10:37.270526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 230/457] 10.222.0.61 () {60 vars in 1261 bytes} [Fri Jun 3 09:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552544705 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 09:10:38.424774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c2f29e0c-2e4e-4d68-afb7-d71837d4f4e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: .version_select at 0x7fd2b1295160>, body: {"keypair": {"name": "tempest-keypair-1418061111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvlNx7NY+Ub2CuUmxhNdp1b8UKbENHTOm8ruKCS35t4MANYPezJ4B1kUWb467SU1zjzHDXMPYE8SWqzy+apNCcpd4LK8aCH6hg8HcJx6EzCnYnEwlO5dHvZj/3wlbYNwQ=="}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:38.440690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c2f29e0c-2e4e-4d68-afb7-d71837d4f4e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for project fd9b906119034d8ea425a5b768b39e39. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:10:38.445081 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c2f29e0c-2e4e-4d68-afb7-d71837d4f4e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for user 22457f943fb84f0794695a132f93a3c3 and project fd9b906119034d8ea425a5b768b39e39. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:10:38.472245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c2f29e0c-2e4e-4d68-afb7-d71837d4f4e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051853 Jun 03 09:10:38.472697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 228/458] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jun 3 09:10:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 09:10:39.829492 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-709262032", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9682f216-a94a-46fd-8ead-2a92b9dc4f42"}], "security_groups": [{"name": "tempest-securitygroup--897146200"}], "key_name": "tempest-keypair-1418061111", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:39.933994 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] validate_networks() for [('9682f216-a94a-46fd-8ead-2a92b9dc4f42', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:10:40.359022 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:10:40.359447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:10:40.359968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:10:40.360383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:10:40.360820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:10:40.370400 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:40.370837 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:40.371654 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:40.372107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:40.389982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for project fd9b906119034d8ea425a5b768b39e39. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:10:40.393904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Getting quotas for user 22457f943fb84f0794695a132f93a3c3 and project fd9b906119034d8ea425a5b768b39e39. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:10:40.405217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:10:40.407501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:10:40.456504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fe90162f-af03-4c6f-bcb5-6462157f4400 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.631791 Jun 03 09:10:40.457330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 231/459] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jun 3 09:10:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 09:10:40.469552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:40.471107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:40.546774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:40.554178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:40.556295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:40.557418 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-940ed72a-f761-4f94-b1b0-ca8004194b39 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1281 microversion: 2.20 time: 0.093500 Jun 03 09:10:40.557985 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 229/460] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:40 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:41.576699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:41.577333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:41.583514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:41.583937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:41.584702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:41.585163 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:41.648041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:41.656233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:41.657702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:41.658792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9c2d6066-4e2b-4f4b-b4a9-d2f0946d7033 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1333 microversion: 2.20 time: 0.086573 Jun 03 09:10:41.659342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 232/461] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:41 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:42.677288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:42.678091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:42.685470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:42.686013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:42.687098 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:42.687616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:42.834926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:42.844016 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:42.846015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:42.846653 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e13e050e-794d-42d3-964e-9eadb46c7d01 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.173284 Jun 03 09:10:42.847217 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 230/462] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:42 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:43.318269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-904a353d-a8eb-4838-b794-40a765892d4d req-f2b6ddd1-d730-4daa-b796-448740edbc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:43.363951 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-904a353d-a8eb-4838-b794-40a765892d4d req-f2b6ddd1-d730-4daa-b796-448740edbc4d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:43.364403 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-904a353d-a8eb-4838-b794-40a765892d4d req-f2b6ddd1-d730-4daa-b796-448740edbc4d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:43.382180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-904a353d-a8eb-4838-b794-40a765892d4d req-f2b6ddd1-d730-4daa-b796-448740edbc4d service nova] Creating event network-changed:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:10:43.388566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-904a353d-a8eb-4838-b794-40a765892d4d req-f2b6ddd1-d730-4daa-b796-448740edbc4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079839 Jun 03 09:10:43.389380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 233/463] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:43.867077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:43.867968 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:43.881565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:43.882021 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:43.882816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:43.883258 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:44.026333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:44.034711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:44.036513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:44.037621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-beeaf63e-37d4-45a1-92b3-628f4b076b4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.176835 Jun 03 09:10:44.038179 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 231/464] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:43 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:45.058112 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:45.058808 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:45.065142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:45.065591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:45.066361 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:45.066794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:45.208502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:45.216620 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:45.218124 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:45.219224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-49adec5f-6df0-4e2a-8610-445a1ca0025c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.166749 Jun 03 09:10:45.219800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 234/465] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:45 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:46.238132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:46.238742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:46.246527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:46.246907 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:46.247943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:46.248404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:46.403963 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:46.414313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:46.416287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:46.417873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8184f773-fe2f-4b99-88cb-31ae9cba8331 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.183344 Jun 03 09:10:46.418446 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 232/466] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:46 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:47.439539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:47.440720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:47.454446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:47.455227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:47.456655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:47.457495 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:47.602653 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:47.611022 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:47.612587 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:47.613728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-953b20b4-8327-4b8c-8aae-e967de2d7be6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.181320 Jun 03 09:10:47.614279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 235/467] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:47 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:48.632009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:48.632638 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:48.639136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:48.639582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:48.640402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:48.640834 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:48.775481 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:48.783441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:48.784989 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:48.786330 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2139f2d5-3969-4b9a-bde0-22244459ee30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.157974 Jun 03 09:10:48.786878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 233/468] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:48 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:49.804341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:49.805024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:49.812641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:49.813142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:49.813920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:49.814360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:49.945372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:49.953624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:49.955138 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:49.956289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e99fa8fe-5e26-437b-a5ae-bca313c0bf7f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.156077 Jun 03 09:10:49.956857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 236/469] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:49 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:50.516724 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ad3378b1-b9c0-4f70-94e7-f2c104db1a3d req-ed1c045c-73f2-4e72-9763-782e3ef1381d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "name": "network-vif-plugged", "status": "completed", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:50.526739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ad3378b1-b9c0-4f70-94e7-f2c104db1a3d req-ed1c045c-73f2-4e72-9763-782e3ef1381d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:50.526739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ad3378b1-b9c0-4f70-94e7-f2c104db1a3d req-ed1c045c-73f2-4e72-9763-782e3ef1381d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:50.537866 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ad3378b1-b9c0-4f70-94e7-f2c104db1a3d req-ed1c045c-73f2-4e72-9763-782e3ef1381d service nova] Creating event network-vif-plugged:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:10:50.543119 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ad3378b1-b9c0-4f70-94e7-f2c104db1a3d req-ed1c045c-73f2-4e72-9763-782e3ef1381d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106978 Jun 03 09:10:50.543718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 234/470] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:10:50.974381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:50.974991 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:50.976967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:50.978140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:50.985144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:50.985538 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:50.986302 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:50.986739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:51.119299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:51.127403 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:51.128932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:51.130021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5f5b17e1-2d94-4342-92b8-ffb9cb240020 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.159539 Jun 03 09:10:51.130581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 237/471] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:50 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:52.148863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:52.150070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:52.152064 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:52.158321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:52.158770 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:52.159537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:52.160066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:52.299982 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:52.308729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:52.310255 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:52.311377 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b0247882-d7cd-4971-83f1-bdd60e72ede5 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1406 microversion: 2.20 time: 0.166812 Jun 03 09:10:52.312005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 235/472] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:52 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:53.329362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:53.329996 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:53.336535 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:53.336989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:53.337749 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:53.338184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:53.467682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:53.476476 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:53.478443 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:10:53.479917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bea1b442-ace5-43bf-a941-d42f95eb4339 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1598 microversion: 2.20 time: 0.154375 Jun 03 09:10:53.480573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 238/473] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:10:53 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:10:53.499167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:10:53.499707 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:10:53.506290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:53.506740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:53.507501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:53.507966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:53.586999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8ec34615-1890-4f62-92ff-3311ed26eb19 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092005 Jun 03 09:10:53.587589 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 236/474] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jun 3 09:10:53 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:10:54.756222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-675d63ef-29e5-467e-964b-69628b6dcb19 req-76f6c3f9-c43c-4eea-860a-d389a0d6da88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:10:54.765227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-675d63ef-29e5-467e-964b-69628b6dcb19 req-76f6c3f9-c43c-4eea-860a-d389a0d6da88 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:10:54.765670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-675d63ef-29e5-467e-964b-69628b6dcb19 req-76f6c3f9-c43c-4eea-860a-d389a0d6da88 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:10:54.777539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-675d63ef-29e5-467e-964b-69628b6dcb19 req-76f6c3f9-c43c-4eea-860a-d389a0d6da88 service nova] Creating event network-changed:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:10:54.782609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-675d63ef-29e5-467e-964b-69628b6dcb19 req-76f6c3f9-c43c-4eea-860a-d389a0d6da88 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030018 Jun 03 09:10:54.783213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 239/475] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:05.972427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:05.973282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:05.977901 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:05.978829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:05.986471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:05.986987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:05.987783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:05.988221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:06.020823 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6564bf1f-9c6c-4754-ae18-35bc91dcec7f tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049886 Jun 03 09:11:06.021392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 237/476] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:11:05 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:11:06.079212 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:06.079816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:06.082141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:06.082810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:06.089229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:06.089680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:06.090448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:06.090883 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:06.122201 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:11:06.218132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-20577c6a-795c-4ab4-9063-2f6654a67fa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 204 len: 0 microversion: 2.1 time: 0.142688 Jun 03 09:11:06.218670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 240/477] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:11:06 2022] DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:11:06.227830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:06.228448 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:06.234638 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:06.235087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:06.235922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:06.236362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:06.371295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:06.378947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9dcb4955-2414-4d2a-b288-3ad1b27bf7c4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1673 microversion: 2.1 time: 0.155557 Jun 03 09:11:06.379501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 238/478] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:06 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:07.396624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:07.397326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:07.404257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:07.404708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:07.405472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:07.405911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:07.539622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:07.547288 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba861134-8054-4770-8b91-f29adb1f7d2c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1673 microversion: 2.1 time: 0.154978 Jun 03 09:11:07.547884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 241/479] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:07 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:08.222935 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-3b42dc30-bcb9-4507-a506-27d1c8314875 req-7f99a95d-0cc2-4b56-be3b-c265bdd290c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66adb02f-314e-4e7b-bd15-d3a2674cfd38", "name": "network-vif-deleted", "tag": "ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:08.232419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-3b42dc30-bcb9-4507-a506-27d1c8314875 req-7f99a95d-0cc2-4b56-be3b-c265bdd290c7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:08.232812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-3b42dc30-bcb9-4507-a506-27d1c8314875 req-7f99a95d-0cc2-4b56-be3b-c265bdd290c7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:08.245523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-3b42dc30-bcb9-4507-a506-27d1c8314875 req-7f99a95d-0cc2-4b56-be3b-c265bdd290c7 service nova] Creating event network-vif-deleted:ebe00f49-2901-4ebe-b9dd-d5c3e91a3ed2 for instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 on hv-cinder-81268 Jun 03 09:11:08.250775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-3b42dc30-bcb9-4507-a506-27d1c8314875 req-7f99a95d-0cc2-4b56-be3b-c265bdd290c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031459 Jun 03 09:11:08.251432 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 239/480] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:08.565339 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:08.565905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:08.572494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:08.572941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:08.573715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:08.574312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:08.607713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:08.608178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:08.608799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lazy-loading 'fault' on Instance uuid 66adb02f-314e-4e7b-bd15-d3a2674cfd38 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:08.677267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:08.686315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d1e531d-1d68-4d75-8a1a-fce816929a2d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 200 len: 1327 microversion: 2.1 time: 0.124813 Jun 03 09:11:08.687219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 242/481] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:08 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:09.703477 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:09.704206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:09.710404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:09.710849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:09.711607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:09.712071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:09.724992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 HTTP/1.1 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:11:09.727116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:11:09.728729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '66adb02f-314e-4e7b-bd15-d3a2674cfd38'} Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:11:09.729656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:11:09.731120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:09.732492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:11:09.732492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-38885550-311f-4796-9d23-ddc934173434 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 404 len: 111 microversion: 2.1 time: 0.029829 Jun 03 09:11:09.732492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 240/482] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:09 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:11:09.737446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3a8e8a93-3a15-48cc-929c-28d0572d5806 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '.version_select at 0x7fd2b1366040>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:09.756028 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3a8e8a93-3a15-48cc-929c-28d0572d5806 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472059948" status: 202 len: 0 microversion: 2.1 time: 0.022377 Jun 03 09:11:09.756622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 09:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472059948 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:11:10.376650 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3b60109f-7582-4288-af0d-5810c0a474f9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: .version_select at 0x7fd2b127df70>, body: {"keypair": {"name": "tempest-keypair-46577685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy2mue529ErCS324LmfpKF1qJ9+wFl7iLiUPdIqcuW/zuKcSqs/xla2Sd/xjzlsU0weOyGd8vgt4ZvJGeOSkts+zjV2mAGOVZBg3giya+cnXXGQuPaovO6Ch1KXPUQWCQ=="}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:10.390314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-3b60109f-7582-4288-af0d-5810c0a474f9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for project 8e442ff861b14d6492a4b27899632a92. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:11:10.394171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-3b60109f-7582-4288-af0d-5810c0a474f9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for user 4a7b71aa00454406ab83a4891a8a719e and project 8e442ff861b14d6492a4b27899632a92. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:11:10.417187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3b60109f-7582-4288-af0d-5810c0a474f9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044534 Jun 03 09:11:10.417771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 241/484] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:11:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:11.646263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-222267607", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f45126da-1a97-463c-b52c-80cba6e90689"}], "security_groups": [{"name": "tempest-securitygroup--3019689"}], "key_name": "tempest-keypair-46577685", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:11.745382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] validate_networks() for [('f45126da-1a97-463c-b52c-80cba6e90689', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:11:12.342332 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:11:12.342835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:11:12.343435 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:11:12.344063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:11:12.344641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:11:12.354297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:12.354747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:12.355543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:12.356004 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:12.373279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for project 8e442ff861b14d6492a4b27899632a92. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:11:12.377317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Getting quotas for user 4a7b71aa00454406ab83a4891a8a719e and project 8e442ff861b14d6492a4b27899632a92. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:11:12.388412 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:11:12.390726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:11:12.437018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-42103517-98d5-4cab-8f39-5e008ad59c61 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.795396 Jun 03 09:11:12.437833 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 244/485] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:11:11 2022] POST /compute/v2.1/servers => generated 399 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:11:12.447981 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b9c7eff2-1aa5-427c-8735-1c79672cc80d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:12.448925 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b9c7eff2-1aa5-427c-8735-1c79672cc80d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:12.506017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b9c7eff2-1aa5-427c-8735-1c79672cc80d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:12.513034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b9c7eff2-1aa5-427c-8735-1c79672cc80d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1235 microversion: 2.1 time: 0.069068 Jun 03 09:11:12.513599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 242/486] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:12 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:13.530807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:13.531532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:13.537955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:13.538403 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:13.539158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:13.539592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:13.602566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:13.610144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db31031c-4d53-4b3e-aa28-5c0f61e9709c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1293 microversion: 2.1 time: 0.083629 Jun 03 09:11:13.610710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 245/487] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:13 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:14.626954 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:14.627868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:14.634697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:14.635152 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:14.635951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:14.636386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:14.765093 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:14.774188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ce773225-8e81-40c7-b2c8-9c2e0c6e9ed8 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.150429 Jun 03 09:11:14.774828 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 243/488] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:14 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:15.000322 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-b87a68bc-cfc8-40e3-b84b-363df3f639bf req-bd1fd371-373f-4f3e-b3f1-e0260702450f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e646c4e-c937-4f0c-8c9c-14af8df51a07", "tag": "990c56c1-914b-454b-9464-f7e9f360f493"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:15.010634 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b87a68bc-cfc8-40e3-b84b-363df3f639bf req-bd1fd371-373f-4f3e-b3f1-e0260702450f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:15.011074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b87a68bc-cfc8-40e3-b84b-363df3f639bf req-bd1fd371-373f-4f3e-b3f1-e0260702450f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:15.022439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-b87a68bc-cfc8-40e3-b84b-363df3f639bf req-bd1fd371-373f-4f3e-b3f1-e0260702450f service nova] Creating event network-changed:990c56c1-914b-454b-9464-f7e9f360f493 for instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 on hv-cinder-81268 Jun 03 09:11:15.027987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-b87a68bc-cfc8-40e3-b84b-363df3f639bf req-bd1fd371-373f-4f3e-b3f1-e0260702450f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031230 Jun 03 09:11:15.028759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 246/489] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:15.791216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:15.791875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:15.798280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:15.798717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:15.799460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:15.799938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:15.931448 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:15.939714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-81e6485f-6ecf-4872-b161-71170fc93da9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.152729 Jun 03 09:11:15.940310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 244/490] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:15 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:16.957562 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:16.958261 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:16.964648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:16.965099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:16.965862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:16.966294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:17.096755 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:17.104001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-77ad350a-ad7c-46bf-b533-c78a464cbb6a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.151174 Jun 03 09:11:17.104558 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 247/491] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:16 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:18.120763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:18.121410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:18.128030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:18.128486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:18.129243 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:18.129708 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:18.257380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:18.265296 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-aa8efc38-95e1-416d-9424-9035ab65163a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.148408 Jun 03 09:11:18.265861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 245/492] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:18 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:19.282857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:19.283390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:19.290834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:19.291280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:19.292207 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:19.292524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:19.426487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:19.433920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2a5169d4-f0a0-45e8-9b82-030575c1c189 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.155186 Jun 03 09:11:19.434481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 248/493] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:19 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:20.450949 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:20.451887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:20.458837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:20.459288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:20.460088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:20.460528 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:20.602112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:20.610907 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-65443277-66a9-4529-9203-94e7cf9c851a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.164260 Jun 03 09:11:20.611483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 246/494] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:20 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:21.627787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:21.628392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:21.635408 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:21.635884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:21.636633 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:21.637059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:21.769104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:21.777039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b1f8adc9-dc01-4b89-bd9f-6beae5377ce9 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.153264 Jun 03 09:11:21.777597 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 249/495] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:21 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:22.461280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:11:22.461847 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:11:22.714908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-43a61e19-7a8e-4736-a0ef-f069b9beeec5 req-5cbd6070-c409-41a2-8d4e-7e90b1598374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c4e-c937-4f0c-8c9c-14af8df51a07", "name": "network-vif-plugged", "status": "completed", "tag": "990c56c1-914b-454b-9464-f7e9f360f493"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:22.719067 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:22.726310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-43a61e19-7a8e-4736-a0ef-f069b9beeec5 req-5cbd6070-c409-41a2-8d4e-7e90b1598374 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:22.726828 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-43a61e19-7a8e-4736-a0ef-f069b9beeec5 req-5cbd6070-c409-41a2-8d4e-7e90b1598374 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:22.745792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-43a61e19-7a8e-4736-a0ef-f069b9beeec5 req-5cbd6070-c409-41a2-8d4e-7e90b1598374 service nova] Creating event network-vif-plugged:990c56c1-914b-454b-9464-f7e9f360f493 for instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 on hv-cinder-81268 Jun 03 09:11:22.751054 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-43a61e19-7a8e-4736-a0ef-f069b9beeec5 req-5cbd6070-c409-41a2-8d4e-7e90b1598374 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039776 Jun 03 09:11:22.752033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 247/496] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:22.799260 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:22.800072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:22.802366 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:22.803237 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:22.812157 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:22.812842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:22.813784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:22.814806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:22.969950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:22.978435 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9054cbf5-a270-4d51-b46c-d86fa2d8af0a tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.186010 Jun 03 09:11:22.979007 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 250/497] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:22 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:23.996851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:23.997547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:24.004231 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.004682 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.005442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.005878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.133628 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:24.140973 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-638c9777-8933-4386-b7e5-cf7e8e9b334b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1358 microversion: 2.1 time: 0.149249 Jun 03 09:11:24.141564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 248/498] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:23 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:24.275811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:24.276329 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:24.282812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.283277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.284050 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.284490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.372424 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'services' on Instance uuid c7d31771-42ff-473f-ac20-ac36676a108b {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:24.444918 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cbd30cf1-8687-4d6b-9b2e-38f12ec3476d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments/123dc552-8190-40a7-b2a4-e0239c9ceec8" status: 202 len: 0 microversion: 2.1 time: 0.172879 Jun 03 09:11:24.445498 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 251/499] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:11:24 2022] DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments/123dc552-8190-40a7-b2a4-e0239c9ceec8 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:11:24.453773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:24.454748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:24.460824 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.461274 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.462559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:24.463001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:24.491886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ec7f010c-33e3-41b5-b286-a91e5c19d13e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041973 Jun 03 09:11:24.492443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 249/500] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:11:24 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:25.158285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:25.158904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:25.165598 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.166047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.166825 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.167242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.299922 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:25.307917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-42fdd3b8-1a03-4636-8722-a08552b4664e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1543 microversion: 2.1 time: 0.153979 Jun 03 09:11:25.308479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 252/501] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:25 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1543 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:25.324452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:25.324983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:25.331575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.331734 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.332525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.332962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.411439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e4f2ac1f-e37f-4540-8af8-c3ce88a82336 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091379 Jun 03 09:11:25.412069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 250/502] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:11:25 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:25.503402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:25.504517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:25.510720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.511285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.512176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:25.512703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:25.543164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7e674bb-1349-4320-ac7b-505cf0632bdf tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Jun 03 09:11:25.544032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 253/503] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:11:25 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:26.331228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-97b00915-70ca-4444-83b8-87d90a27214e req-a118d7fc-f9bf-4f7d-b776-92b0873a9389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e646c4e-c937-4f0c-8c9c-14af8df51a07", "tag": "990c56c1-914b-454b-9464-f7e9f360f493"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:26.340312 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-97b00915-70ca-4444-83b8-87d90a27214e req-a118d7fc-f9bf-4f7d-b776-92b0873a9389 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.340758 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-97b00915-70ca-4444-83b8-87d90a27214e req-a118d7fc-f9bf-4f7d-b776-92b0873a9389 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.351623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-97b00915-70ca-4444-83b8-87d90a27214e req-a118d7fc-f9bf-4f7d-b776-92b0873a9389 service nova] Creating event network-changed:990c56c1-914b-454b-9464-f7e9f360f493 for instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 on hv-cinder-81268 Jun 03 09:11:26.357200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-97b00915-70ca-4444-83b8-87d90a27214e req-a118d7fc-f9bf-4f7d-b776-92b0873a9389 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029734 Jun 03 09:11:26.357852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 251/504] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:26.555368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:26.556679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:26.564774 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.565224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.566208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.566842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.598069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-67c7cf15-3b7f-42d4-aebd-82c3e1e2bf61 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047309 Jun 03 09:11:26.598649 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 254/505] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:11:26 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:11:26.675884 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:26.676583 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:26.684780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.685507 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.686471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.687070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.713386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:11:26.798240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d1dd3bc5-b905-4296-a161-35a4ea5d1db3 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 204 len: 0 microversion: 2.1 time: 0.127526 Jun 03 09:11:26.798961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 252/506] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:11:26 2022] DELETE /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:11:26.807677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:26.808320 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:26.814646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.815199 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.816555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:26.817055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:26.957396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:26.965079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-65a55a3a-565f-4598-800e-f72cc5a0cf4a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1689 microversion: 2.1 time: 0.161912 Jun 03 09:11:26.966034 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 255/507] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:26 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:27.982733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:27.983434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:27.990001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:27.990702 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:27.991203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:27.991639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:28.122657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:28.130165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1101bd01-f992-486e-a950-56220d8943c6 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1689 microversion: 2.1 time: 0.151708 Jun 03 09:11:28.130721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 253/508] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:27 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:29.147614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:29.148252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:29.154796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:29.155248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:29.156050 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:29.156488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:29.160821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:29.289081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:29.297557 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-81e9610c-a9ce-4110-946f-793b5c55fa2a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1689 microversion: 2.1 time: 0.153704 Jun 03 09:11:29.298095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 256/509] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:29 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:30.315095 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:30.315705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:30.322568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:30.323018 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:30.323791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:30.324238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:30.454946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:30.463506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9d3650b6-bdbd-4029-bdc5-f5d1f0d8420e tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1689 microversion: 2.1 time: 0.152287 Jun 03 09:11:30.464214 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 254/510] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:30 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:31.188753 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-3b2dae29-2bb8-42be-925c-5ffee2c11846 req-1c9b9bc5-e7bd-4d46-8f88-a39e20e09a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d31771-42ff-473f-ac20-ac36676a108b", "name": "network-vif-deleted", "tag": "acc179ca-0cc2-4047-8a3a-b763976f8412"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:31.198828 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3b2dae29-2bb8-42be-925c-5ffee2c11846 req-1c9b9bc5-e7bd-4d46-8f88-a39e20e09a74 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:31.199271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3b2dae29-2bb8-42be-925c-5ffee2c11846 req-1c9b9bc5-e7bd-4d46-8f88-a39e20e09a74 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:31.211016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-3b2dae29-2bb8-42be-925c-5ffee2c11846 req-1c9b9bc5-e7bd-4d46-8f88-a39e20e09a74 service nova] Creating event network-vif-deleted:acc179ca-0cc2-4047-8a3a-b763976f8412 for instance c7d31771-42ff-473f-ac20-ac36676a108b on hv-cinder-81268 Jun 03 09:11:31.218269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-3b2dae29-2bb8-42be-925c-5ffee2c11846 req-1c9b9bc5-e7bd-4d46-8f88-a39e20e09a74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Jun 03 09:11:31.218896 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 257/511] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:31.480867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:31.481506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:31.488080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:31.488524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:31.489269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:31.489693 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:31.523009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:31.523380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:31.523846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'fault' on Instance uuid c7d31771-42ff-473f-ac20-ac36676a108b {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:31.564727 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:31.574666 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-55c87bd8-1f67-4df4-acdf-ec18beaee98a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 200 len: 1334 microversion: 2.1 time: 0.097573 Jun 03 09:11:31.575244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 255/512] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:31 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:32.592868 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:32.593550 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: c7d31771-42ff-473f-ac20-ac36676a108b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:32.599671 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:32.600144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:32.600897 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:32.601327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:32.615353 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] HTTP exception thrown: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Request method failure captured: Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b HTTP/1.1 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc73ctoiRmLt8EVyZOLRx5b0zVVA3wygWU4BbNCjns6QQa8Z4_d_A-lBpi05iJXcmK9dViZwPIkV5ZD8VqhzLPMYYK__trQ7lwqlUBejjaZkk_inJQhlfsw8daDtZBzyKHjAaDNm7PkCujEEqDiFZrI-aBaimHcefyib54sTZtaDDR0 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:11:32.617027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 3d8fbafbd63c4e1c946b414e2842eb91 Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. Jun 03 09:11:32.618705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'c7d31771-42ff-473f-ac20-ac36676a108b'} Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:11:32.619958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. Jun 03 09:11:32.621702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:32.623475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Returning 404 to user: Instance c7d31771-42ff-473f-ac20-ac36676a108b could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:11:32.623475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0fcd3b2-4e2b-481e-ace6-374169dd2a74 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b" status: 404 len: 111 microversion: 2.1 time: 0.030284 Jun 03 09:11:32.623475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 258/513] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:32 2022] GET /compute/v2.1/servers/c7d31771-42ff-473f-ac20-ac36676a108b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:11:32.627822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8ae2d565-0fb9-4970-a4ee-6f1ee5fd51fd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '.version_select at 0x7fd2b124f790>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:32.645357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8ae2d565-0fb9-4970-a4ee-6f1ee5fd51fd tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518512375" status: 202 len: 0 microversion: 2.1 time: 0.021300 Jun 03 09:11:32.645897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 256/514] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 09:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518512375 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:11:35.706401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:35.706930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:35.713589 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:35.714046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:35.714805 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:35.715240 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:35.744176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:11:35.823241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-270d21e7-80f5-4d81-abf4-e0542539c613 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 204 len: 0 microversion: 2.1 time: 0.120160 Jun 03 09:11:35.824532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 259/515] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:11:35 2022] DELETE /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:11:35.836006 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:35.836663 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:35.847400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:35.847880 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:35.848642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:35.849073 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:35.868393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:35.981523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:35.989078 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ebbd8b21-16af-4ba1-83b9-1b258ebf18f2 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1508 microversion: 2.1 time: 0.160303 Jun 03 09:11:35.989648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 257/516] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:35 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:11:37.007029 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:37.007734 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:37.010672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:37.016471 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:37.016915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:37.017682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:37.018170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:37.151348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:37.158673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7caa98ee-e40d-42ec-9c8c-ee8a78a21172 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1508 microversion: 2.1 time: 0.155910 Jun 03 09:11:37.159230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 260/517] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:37 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:37.998285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-4aed6a51-18df-4ccb-a229-5ab21b93582a req-fcfb7d4c-36e8-4b23-80fb-88c4f7b754e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4489255-77da-411b-b2ab-c394031a65f6", "name": "network-vif-deleted", "tag": "fca4eadf-000a-44f7-8901-956a84dbd765"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:38.003614 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:38.010053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-4aed6a51-18df-4ccb-a229-5ab21b93582a req-fcfb7d4c-36e8-4b23-80fb-88c4f7b754e5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:38.010509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-4aed6a51-18df-4ccb-a229-5ab21b93582a req-fcfb7d4c-36e8-4b23-80fb-88c4f7b754e5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:38.037425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-4aed6a51-18df-4ccb-a229-5ab21b93582a req-fcfb7d4c-36e8-4b23-80fb-88c4f7b754e5 service nova] Creating event network-vif-deleted:fca4eadf-000a-44f7-8901-956a84dbd765 for instance f4489255-77da-411b-b2ab-c394031a65f6 on hv-cinder-81268 Jun 03 09:11:38.043334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-4aed6a51-18df-4ccb-a229-5ab21b93582a req-fcfb7d4c-36e8-4b23-80fb-88c4f7b754e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048598 Jun 03 09:11:38.044088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 258/518] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:38.175340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:38.176007 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:38.182902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:38.183344 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:38.184129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:38.184554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:38.215247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:38.215627 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:38.216104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'fault' on Instance uuid f4489255-77da-411b-b2ab-c394031a65f6 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:38.256831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:38.265357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f518bc46-e138-4195-be97-f16151f6f01a tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 200 len: 1312 microversion: 2.1 time: 0.093818 Jun 03 09:11:38.265940 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 261/519] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:38 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:39.283709 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:39.284353 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: f4489255-77da-411b-b2ab-c394031a65f6] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:39.293489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.293942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.294840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.295310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.309068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] HTTP exception thrown: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Request method failure captured: Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 HTTP/1.1 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc73ctoiRmLt8EVyZOLRx5b0zVVA3wygWU4BbNCjns6QQa8Z4_d_A-lBpi05iJXcmK9dViZwPIkV5ZD8VqhzLPMYYK__trQ7lwqlUBejjaZkk_inJQhlfsw8daDtZBzyKHjAaDNm7PkCujEEqDiFZrI-aBaimHcefyib54sTZtaDDR0 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:11:39.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 3d8fbafbd63c4e1c946b414e2842eb91 Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. Jun 03 09:11:39.312368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'f4489255-77da-411b-b2ab-c394031a65f6'} Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:11:39.313183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. Jun 03 09:11:39.314419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:11:39.315498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Returning 404 to user: Instance f4489255-77da-411b-b2ab-c394031a65f6 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:11:39.315498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bc2a40e4-1702-41f3-808a-2cdcc295753d tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6" status: 404 len: 111 microversion: 2.1 time: 0.033366 Jun 03 09:11:39.315498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 259/520] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:39 2022] GET /compute/v2.1/servers/f4489255-77da-411b-b2ab-c394031a65f6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:11:39.320789 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:39.321767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:39.328170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.328615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.329367 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.329804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.356141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:11:39.429777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-82e7a3f2-ca88-48ef-a57c-6001e5477ce8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 204 len: 0 microversion: 2.1 time: 0.112314 Jun 03 09:11:39.430590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 262/521] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:11:39 2022] DELETE /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:11:39.439470 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:39.440093 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:39.446557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.446999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.447743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:39.448189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:39.580091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:39.588223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f098083d-98fd-47a9-b47e-5ed44489e909 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.152573 Jun 03 09:11:39.588781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 260/522] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:39 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:40.606273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:40.606998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:40.613440 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:40.614018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:40.614639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:40.615077 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:40.743925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:40.751602 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f97c0f4f-d88a-4a5d-8e1e-5733a8515346 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.150231 Jun 03 09:11:40.752199 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 263/523] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:40 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:41.433569 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:41.434143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:41.440587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.441037 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.441796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.442266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.468362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:11:41.548196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8a6fdce0-a30d-41e3-919c-6d7a30309766 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 204 len: 0 microversion: 2.1 time: 0.118616 Jun 03 09:11:41.548813 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 261/524] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:11:41 2022] DELETE /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:11:41.557429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:41.558155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:41.564538 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.564986 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.565753 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.566195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.695305 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:41.703140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8f1d96e7-2e3f-41d3-a018-446a27bfc7b9 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1578 microversion: 2.1 time: 0.150198 Jun 03 09:11:41.703702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 264/525] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:41 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:41.769547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:41.770233 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:41.776276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.776716 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.777467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:41.777897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:41.915952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:41.923433 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1891157f-9c69-46ac-a23a-b412c82383c8 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.158139 Jun 03 09:11:41.924039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 262/526] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:41 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:42.720639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:42.721239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:42.727820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:42.728271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:42.729077 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:42.729518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:42.862829 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:42.870778 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6dc37d38-2aef-4652-be36-85ed9115de79 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1578 microversion: 2.1 time: 0.154046 Jun 03 09:11:42.871333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 265/527] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:42 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:11:42.941281 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:42.943828 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:42.949116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:42.949559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:42.950319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:42.950746 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:43.082552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:43.090056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ceaa8bee-6dde-43e5-b4ba-8aa0a55a0074 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1521 microversion: 2.1 time: 0.152913 Jun 03 09:11:43.090617 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 263/528] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:42 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:43.848084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-9d02883c-6f85-4ace-8def-ce7efc7f5cb3 req-0a6cf900-6023-49b2-9936-5af566e7c13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c6e82d-0519-446f-8cca-e6b14fbdcf01", "name": "network-vif-deleted", "tag": "b6234620-8e7f-462f-866d-2a556b7500b9"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:43.857614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9d02883c-6f85-4ace-8def-ce7efc7f5cb3 req-0a6cf900-6023-49b2-9936-5af566e7c13e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:43.858453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9d02883c-6f85-4ace-8def-ce7efc7f5cb3 req-0a6cf900-6023-49b2-9936-5af566e7c13e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:43.871681 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-9d02883c-6f85-4ace-8def-ce7efc7f5cb3 req-0a6cf900-6023-49b2-9936-5af566e7c13e service nova] Creating event network-vif-deleted:b6234620-8e7f-462f-866d-2a556b7500b9 for instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 on hv-cinder-81268 Jun 03 09:11:43.879117 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-9d02883c-6f85-4ace-8def-ce7efc7f5cb3 req-0a6cf900-6023-49b2-9936-5af566e7c13e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033742 Jun 03 09:11:43.879737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 266/529] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:43.887221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:43.887858 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:43.898615 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:43.899283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:43.900279 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:43.900910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:44.066793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:44.075438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-02528428-c11f-47d9-9677-2f98681630a8 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1578 microversion: 2.1 time: 0.192085 Jun 03 09:11:44.076024 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 264/530] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:43 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:44.107044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:44.107747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:44.114007 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:44.114457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:44.115227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:44.115687 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:44.147369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:44.147853 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:44.148308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lazy-loading 'fault' on Instance uuid b5c6e82d-0519-446f-8cca-e6b14fbdcf01 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:44.197475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8fbafbd63c4e1c946b414e2842eb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e85f2b75a14a31ac1498fa9ac1d243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:44.205280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-09e9173b-7ee6-47a5-a5cc-13cdfb3d191f tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 200 len: 1311 microversion: 2.1 time: 0.102463 Jun 03 09:11:44.205878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 267/531] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:44 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:45.093683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:45.094248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:45.100694 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.101134 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.101884 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.103061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.134020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.134675 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.135121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lazy-loading 'fault' on Instance uuid ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:11:45.179161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:45.187034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e271d05b-5e58-443f-8272-d674752bdf27 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 200 len: 1230 microversion: 2.1 time: 0.097679 Jun 03 09:11:45.187928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 265/532] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:45 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:11:45.222145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:45.222788 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] [instance: b5c6e82d-0519-446f-8cca-e6b14fbdcf01] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:45.230489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.230943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.231715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.232178 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.246172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] HTTP exception thrown: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Request method failure captured: Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 HTTP/1.1 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc73ctoiRmLt8EVyZOLRx5b0zVVA3wygWU4BbNCjns6QQa8Z4_d_A-lBpi05iJXcmK9dViZwPIkV5ZD8VqhzLPMYYK__trQ7lwqlUBejjaZkk_inJQhlfsw8daDtZBzyKHjAaDNm7PkCujEEqDiFZrI-aBaimHcefyib54sTZtaDDR0 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:11:45.247980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74e85f2b75a14a31ac1498fa9ac1d243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 74e85f2b75a14a31ac1498fa9ac1d243 Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1860801125 Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 3d8fbafbd63c4e1c946b414e2842eb91 Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1860801125-project Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. Jun 03 09:11:45.249483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'b5c6e82d-0519-446f-8cca-e6b14fbdcf01'} Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:11:45.250308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. Jun 03 09:11:45.251468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:45.252565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] Returning 404 to user: Instance b5c6e82d-0519-446f-8cca-e6b14fbdcf01 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:11:45.252565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8d749931-dee6-4fbf-85c5-6e487fc30979 tempest-ServerRescueNegativeTestJSON-1860801125 tempest-ServerRescueNegativeTestJSON-1860801125-project] 10.222.0.61 "GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01" status: 404 len: 111 microversion: 2.1 time: 0.031148 Jun 03 09:11:45.252565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 268/533] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:45 2022] GET /compute/v2.1/servers/b5c6e82d-0519-446f-8cca-e6b14fbdcf01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:11:45.915704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-d328953b-360a-4c62-a258-c4d1367a393e req-ba20eb9a-2009-43eb-8537-185329d307e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca", "name": "network-vif-deleted", "tag": "c69651d2-25f9-4aec-a409-cab23b429adc"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:45.923722 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d328953b-360a-4c62-a258-c4d1367a393e req-ba20eb9a-2009-43eb-8537-185329d307e3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:45.924210 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d328953b-360a-4c62-a258-c4d1367a393e req-ba20eb9a-2009-43eb-8537-185329d307e3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:45.935139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-d328953b-360a-4c62-a258-c4d1367a393e req-ba20eb9a-2009-43eb-8537-185329d307e3 service nova] Creating event network-vif-deleted:c69651d2-25f9-4aec-a409-cab23b429adc for instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca on hv-cinder-81268 Jun 03 09:11:45.940134 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-d328953b-360a-4c62-a258-c4d1367a393e req-ba20eb9a-2009-43eb-8537-185329d307e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Jun 03 09:11:45.940726 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 266/534] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:46.204791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:46.205291 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:46.211324 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:46.212322 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:46.213072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:46.213497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:46.227046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] HTTP exception thrown: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Request method failure captured: Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca HTTP/1.1 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc918kmZdxRzMCI1CzIKmBh6gR5wDmGDVPuaSjyO7jLH-hd8n7QzXJFAKkgB2HlWM0U-8gjQKi_BEJPRZPZXh1Kt3OJi4c3re9ZAH64mV0AowxSXhnQguXAQuw0qaVwVHVkmf8BlUTalxONMKsua8nLgIyeImbIxQpWQXX9qANelQ5s Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:11:46.228593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: acbec87f607d4e00a2107c572fc68643 Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:11:46.230226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca'} Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:11:46.244485 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:11:46.245889 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:11:46.247170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Returning 404 to user: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:11:46.247170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-32b02969-9cb0-473b-93ae-ac628ed6c8cb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 404 len: 111 microversion: 2.1 time: 0.029212 Jun 03 09:11:46.247170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 269/535] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:46 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:11:46.340324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-906028269", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615997502", "security_groups": [{"name": "tempest-secgroup-smoke-2001127604"}], "block_device_mapping_v2": [{"uuid": "5c199f85-4ffa-499e-a509-89c48d8e5085", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db505cc9-4748-4bbb-a7a3-c41105ee8dab"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:46.477277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] validate_networks() for [('db505cc9-4748-4bbb-a7a3-c41105ee8dab', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:11:46.919612 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:11:46.920061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:11:46.920537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:11:46.920993 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:11:46.921367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:11:46.930739 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:46.931190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:46.932026 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:46.933091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:46.950439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:11:46.954506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for user acbec87f607d4e00a2107c572fc68643 and project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:11:47.021602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:11:47.024030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c199f85-4ffa-499e-a509-89c48d8e5085',volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:11:47.180833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2413577e-ad24-4a83-8964-9eb0a4698577 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844430 Jun 03 09:11:47.188946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 267/536] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:11:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:11:47.199150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c6c0ce9f-0d79-4087-9e2d-fcb98c5fad06 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:47.199810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c6c0ce9f-0d79-4087-9e2d-fcb98c5fad06 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:47.256524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c6c0ce9f-0d79-4087-9e2d-fcb98c5fad06 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:47.267535 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c6c0ce9f-0d79-4087-9e2d-fcb98c5fad06 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1093 microversion: 2.1 time: 0.072219 Jun 03 09:11:47.276801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 270/537] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:47 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:48.286664 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:48.287509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:48.296918 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:48.297795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:48.298718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:48.299512 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:48.388983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:48.396699 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-309b4f68-0d7a-40ec-8b28-933b8f4b9c17 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1209 microversion: 2.1 time: 0.114570 Jun 03 09:11:48.397265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 268/538] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:48 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:49.413713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:49.414373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:49.423688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:49.424174 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:49.424936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:49.425372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:49.638903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:49.646852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9734542-f59f-4488-ab4c-74714519fa8d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.237061 Jun 03 09:11:49.647430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 271/539] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:49 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:50.199063 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-0d6b4e44-d6d7-44fc-bdb4-530b1ae9967a req-1eb8ac2f-1764-4414-9cd0-0c6fc446b179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30102330-9ba1-483c-9283-25fae41e9c17", "tag": "05e4a310-78b5-4e1d-80e0-25fec9828098"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:11:50.214556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-0d6b4e44-d6d7-44fc-bdb4-530b1ae9967a req-1eb8ac2f-1764-4414-9cd0-0c6fc446b179 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:50.215204 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-0d6b4e44-d6d7-44fc-bdb4-530b1ae9967a req-1eb8ac2f-1764-4414-9cd0-0c6fc446b179 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:50.232157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-0d6b4e44-d6d7-44fc-bdb4-530b1ae9967a req-1eb8ac2f-1764-4414-9cd0-0c6fc446b179 service nova] Creating event network-changed:05e4a310-78b5-4e1d-80e0-25fec9828098 for instance 30102330-9ba1-483c-9283-25fae41e9c17 on hv-cinder-81268 Jun 03 09:11:50.240648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-0d6b4e44-d6d7-44fc-bdb4-530b1ae9967a req-1eb8ac2f-1764-4414-9cd0-0c6fc446b179 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046811 Jun 03 09:11:50.241422 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 269/540] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:11:50.664615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:50.665328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:50.671787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:50.672260 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:50.673041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:50.673444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:50.813640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:50.822471 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-72d903e8-e349-407a-8b18-3cff655768ca tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.161973 Jun 03 09:11:50.823037 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 272/541] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:50 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:51.840499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:51.841360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:51.847874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:51.848324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:51.849082 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:51.849725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:52.033645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:52.044778 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-11d1e814-e6ac-4499-a1dc-cb89d2c0bb2e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.209722 Jun 03 09:11:52.045860 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 270/542] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:51 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:53.068697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:53.069313 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:53.075743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:53.076221 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:53.076983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:53.077414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:53.081546 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:53.231361 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:53.239272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a36643c0-ef9d-4390-880d-394906c5f056 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.174410 Jun 03 09:11:53.239965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 273/543] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:53 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:54.256672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:54.257286 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:54.264017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:54.264468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:54.265307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:54.265710 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:54.400086 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:54.407736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7f84cf56-d2aa-418e-bf4a-5173416e72c4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.155193 Jun 03 09:11:54.408333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 271/544] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:54 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:55.425482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:55.426094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:55.433155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:55.433657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:55.434454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:55.434935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:55.568794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:55.577273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-28a259b6-bd60-4ebf-ba5b-559180363fbd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.155718 Jun 03 09:11:55.577952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 274/545] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:55 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:56.594633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:56.595458 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:56.602322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:56.602780 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:56.603548 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:56.604011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:56.809740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:56.817605 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-092e7c98-7ddb-4a5d-9e2d-066761a39a18 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.226866 Jun 03 09:11:56.818234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 272/546] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:56 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:57.836250 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:57.837579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:57.840055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:57.845997 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:57.846451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:57.847410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:57.847882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:58.014455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:58.025226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2830e8d6-d362-4795-a88e-c33d7d1ea437 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.192131 Jun 03 09:11:58.034570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 275/547] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:57 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:11:59.042681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:11:59.043291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:11:59.045283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:59.045934 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:59.052313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:59.052767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:59.053525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:11:59.053962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:11:59.182941 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:11:59.190369 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8ed1db67-4c00-4ea7-9050-ad5197b8e22d tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.152042 Jun 03 09:11:59.190933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 273/548] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:11:59 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:00.206357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:00.206964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:00.213682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:00.214131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:00.214900 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:00.215369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:00.346579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:00.354468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c7bb0ec-6bd5-4826-93f0-a516759b3ca4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.152006 Jun 03 09:12:00.355026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 276/549] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:00 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:00.804125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e3d80669-a023-48b1-8fea-6c1188875d1d req-3d383694-4c2e-40b1-8514-e9c24b447cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30102330-9ba1-483c-9283-25fae41e9c17", "name": "network-vif-plugged", "status": "completed", "tag": "05e4a310-78b5-4e1d-80e0-25fec9828098"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:00.813180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e3d80669-a023-48b1-8fea-6c1188875d1d req-3d383694-4c2e-40b1-8514-e9c24b447cc9 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:00.813180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e3d80669-a023-48b1-8fea-6c1188875d1d req-3d383694-4c2e-40b1-8514-e9c24b447cc9 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:00.824853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e3d80669-a023-48b1-8fea-6c1188875d1d req-3d383694-4c2e-40b1-8514-e9c24b447cc9 service nova] Creating event network-vif-plugged:05e4a310-78b5-4e1d-80e0-25fec9828098 for instance 30102330-9ba1-483c-9283-25fae41e9c17 on hv-cinder-81268 Jun 03 09:12:00.830568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e3d80669-a023-48b1-8fea-6c1188875d1d req-3d383694-4c2e-40b1-8514-e9c24b447cc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 Jun 03 09:12:00.831332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 274/550] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:01.371253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:01.371795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:01.378312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:01.378759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:01.379517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:01.379987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:01.516018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:01.523363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3fa04a40-0ec6-4078-8c9d-dd124c87d88b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.156084 Jun 03 09:12:01.523947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 277/551] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:01 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:02.542426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:02.543322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:02.549645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:02.550097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:02.550860 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:02.551294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:02.685653 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:02.693085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2101d9f6-002f-4370-9338-43e4f9d00924 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1265 microversion: 2.1 time: 0.156435 Jun 03 09:12:02.693642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 275/552] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:02 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:12:03.710222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:03.711084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:03.718797 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:03.719360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:03.720373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:03.720731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:03.862259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:03.869886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6813eb09-6a5a-4fd2-aca8-b3bf1ff60a02 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1453 microversion: 2.1 time: 0.163632 Jun 03 09:12:03.870443 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 278/553] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:03 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:03.885676 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:03.886283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:03.892683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:03.893132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:03.893948 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:03.894332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:03.898439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:04.028926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:04.036660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-adcbae20-6be9-44e8-ad0c-4ce1cf733da5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1453 microversion: 2.1 time: 0.154810 Jun 03 09:12:04.037215 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 276/554] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:03 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:05.696179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-559877a2-a902-4aa3-8eee-d1ee1ab09641 req-20bbd25a-16fa-4b0e-8629-c0a8b8ea4a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30102330-9ba1-483c-9283-25fae41e9c17", "tag": "05e4a310-78b5-4e1d-80e0-25fec9828098"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:05.705473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-559877a2-a902-4aa3-8eee-d1ee1ab09641 req-20bbd25a-16fa-4b0e-8629-c0a8b8ea4a24 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:05.705917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-559877a2-a902-4aa3-8eee-d1ee1ab09641 req-20bbd25a-16fa-4b0e-8629-c0a8b8ea4a24 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:05.717814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-559877a2-a902-4aa3-8eee-d1ee1ab09641 req-20bbd25a-16fa-4b0e-8629-c0a8b8ea4a24 service nova] Creating event network-changed:05e4a310-78b5-4e1d-80e0-25fec9828098 for instance 30102330-9ba1-483c-9283-25fae41e9c17 on hv-cinder-81268 Jun 03 09:12:05.722892 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-559877a2-a902-4aa3-8eee-d1ee1ab09641 req-20bbd25a-16fa-4b0e-8629-c0a8b8ea4a24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030418 Jun 03 09:12:05.723739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 279/555] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:17.801446 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1237741507", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "networks": [{"uuid": "f161c96f-8fee-4fc4-858a-a2d1cf09a892"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:17.808738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:17.809389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=4 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:17.858599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] validate_networks() for [('f161c96f-8fee-4fc4-858a-a2d1cf09a892', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:12:18.218488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:12:18.218910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:12:18.219386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:12:18.219829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:12:18.220248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:12:18.229180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:18.229554 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:18.230350 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:18.230793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:18.247849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Getting quotas for project 550b6a4abd9342caa18f150846d0277d. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:12:18.251825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Getting quotas for user 544a8ed11787431db393494eefcba2e6 and project 550b6a4abd9342caa18f150846d0277d. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:12:18.263323 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:12:18.265633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:12:18.312621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-de53d493-1562-4c83-9d0b-3bd75fc3419f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514728 Jun 03 09:12:18.313402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 277/556] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:12:18.321942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:18.323114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=36 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:18.328705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-272060b5-044c-4c07-88fc-151f1c9df079 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:18.329428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-272060b5-044c-4c07-88fc-151f1c9df079 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:18.385799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-272060b5-044c-4c07-88fc-151f1c9df079 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:18.393447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-272060b5-044c-4c07-88fc-151f1c9df079 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1219 microversion: 2.1 time: 0.073310 Jun 03 09:12:18.394019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 280/557] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:18 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:19.411610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:19.412342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:19.419434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:19.419910 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:19.420679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:19.421117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:19.483609 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:19.491088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2591956e-1f70-47b3-9d31-0a51049864f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1277 microversion: 2.1 time: 0.084387 Jun 03 09:12:19.491661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 278/558] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:19 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:20.510938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:20.510938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:20.514768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-65c995f6-ff06-420f-8b27-9c3942aa54d8 req-9d39cfd1-8704-4da5-923b-d8cab5030826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8c2993-0afa-4e6a-9a51-e1917beb477b", "tag": "450485c6-ee44-40dc-8dac-375e896665be"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:20.522387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:20.522924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:20.523780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:20.524457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:20.527462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-65c995f6-ff06-420f-8b27-9c3942aa54d8 req-9d39cfd1-8704-4da5-923b-d8cab5030826 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:20.528189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-65c995f6-ff06-420f-8b27-9c3942aa54d8 req-9d39cfd1-8704-4da5-923b-d8cab5030826 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:20.543651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-65c995f6-ff06-420f-8b27-9c3942aa54d8 req-9d39cfd1-8704-4da5-923b-d8cab5030826 service nova] Creating event network-changed:450485c6-ee44-40dc-8dac-375e896665be for instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b on hv-cinder-81268 Jun 03 09:12:20.550466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-65c995f6-ff06-420f-8b27-9c3942aa54d8 req-9d39cfd1-8704-4da5-923b-d8cab5030826 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041222 Jun 03 09:12:20.551500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 279/559] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:12:20.670233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:20.677877 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cf00453-4088-431e-8476-49f243f5c5da tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.173124 Jun 03 09:12:20.678458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 281/560] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:20 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:21.694989 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:21.695688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:21.702402 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:21.702845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:21.703600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:21.704069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:21.709187 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:21.709187 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:21.715965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:21.716415 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:21.717217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:21.717647 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:21.741161 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-26203dbc-4bd7-418b-87b4-52d15d340d4a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/ips" status: 200 len: 152 microversion: 2.20 time: 0.036440 Jun 03 09:12:21.741759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 282/561] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jun 3 09:12:21 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:12:21.839234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:21.847269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-aecc487a-62fc-406f-93f0-e2f86afd3698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.156416 Jun 03 09:12:21.847945 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 280/562] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:21 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:22.865718 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:22.866248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:22.874876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:22.875326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:22.876141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:22.876577 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:23.011843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:23.020521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b9a8a339-0886-4875-b390-ce3a01498698 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.159172 Jun 03 09:12:23.021298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 283/563] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:22 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:23.538039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:23.538591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:23.545955 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:23.546394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:23.547138 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:23.547563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:23.574222 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lazy-loading 'flavor' on Instance uuid b2aca80f-2256-4b33-921d-d9ef617926a9 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:12:23.835547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cd295d79-2807-42cf-890c-13f1cc9a495e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/action" status: 202 len: 0 microversion: 2.20 time: 0.301354 Jun 03 09:12:23.836341 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 281/564] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 09:12:23 2022] POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:12:23.844842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:23.845444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:23.851319 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:23.851862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:23.852551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:23.852977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:23.989463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:23.998052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:23.999555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:24.000743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a88e7ea6-22e0-4bd6-be38-ad96d0228bf7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.159736 Jun 03 09:12:24.001334 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 284/565] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:23 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:12:24.038278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:24.038975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:24.045276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:24.045728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:24.046482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:24.046914 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:24.178356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:24.186726 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b1a17d79-286b-497a-88e5-3c52198a3cb1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.152948 Jun 03 09:12:24.187296 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 282/566] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:24 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:25.020025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:25.020638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:25.027831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:25.028286 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:25.029048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:25.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:25.160787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:25.168932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:25.170470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:25.171608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6558e039-9f76-4cf6-a159-e5e90de042a0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.155517 Jun 03 09:12:25.172197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 285/567] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:25 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:25.202695 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:25.203311 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:25.209848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:25.210296 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:25.211051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:25.211484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:25.342737 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:25.350177 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c83fb294-1903-4ed4-9f02-34335808c572 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.151303 Jun 03 09:12:25.350742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 283/568] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:25 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:26.190228 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:26.190815 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:26.197460 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:26.198273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:26.199042 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:26.199477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:26.332488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:26.340932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:26.342429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:26.343564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cb32de70-f66d-4ade-9450-2bb09c7dd4b0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.157292 Jun 03 09:12:26.344161 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 286/569] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:26 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:12:26.366806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:26.367448 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:26.373826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:26.374265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:26.375017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:26.375446 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:26.502956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:26.510798 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8aff1755-18dc-4f5c-a7ae-584068cfb2f7 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.147455 Jun 03 09:12:26.511361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 284/570] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:26 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:27.019356 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-98cf6c97-caa2-4ad7-9c64-b3ebbf071371 req-2a337ec3-54d9-460f-a912-69dd32ec6dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8c2993-0afa-4e6a-9a51-e1917beb477b", "name": "network-vif-plugged", "status": "completed", "tag": "450485c6-ee44-40dc-8dac-375e896665be"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:27.028225 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-98cf6c97-caa2-4ad7-9c64-b3ebbf071371 req-2a337ec3-54d9-460f-a912-69dd32ec6dc4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:27.028764 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-98cf6c97-caa2-4ad7-9c64-b3ebbf071371 req-2a337ec3-54d9-460f-a912-69dd32ec6dc4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:27.041751 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-98cf6c97-caa2-4ad7-9c64-b3ebbf071371 req-2a337ec3-54d9-460f-a912-69dd32ec6dc4 service nova] Creating event network-vif-plugged:450485c6-ee44-40dc-8dac-375e896665be for instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b on hv-cinder-81268 Jun 03 09:12:27.046682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-98cf6c97-caa2-4ad7-9c64-b3ebbf071371 req-2a337ec3-54d9-460f-a912-69dd32ec6dc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Jun 03 09:12:27.047446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 287/571] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:27.361591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:27.362202 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:27.368611 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:27.369255 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:27.370468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:27.370908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:27.503507 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:27.511652 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:27.513175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:27.514322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e14ec124-acdc-43b7-9736-7e203883f777 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.156811 Jun 03 09:12:27.514873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 285/572] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:27 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:27.526824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:27.527552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:27.534009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:27.534452 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:27.535459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:27.535920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:27.884770 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:27.892151 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4aeaf496-cde6-4767-858b-bee03ca9fbf1 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.369494 Jun 03 09:12:27.892717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 288/573] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:27 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:28.532329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:28.532932 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:28.535140 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:28.535831 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:28.541992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:28.542434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:28.543184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:28.543608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:28.672670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:28.680612 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:28.682617 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:28.683786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-16d1d76c-6716-4558-a921-74b474b58c4b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.155294 Jun 03 09:12:28.684337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 286/574] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:28 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:12:28.911299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:28.911951 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:28.913927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:28.920006 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:28.920448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:28.921194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:28.921617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:29.049775 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:29.057850 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2a86441c-7893-4a3f-a9f2-1c243fd58ef5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1319 microversion: 2.1 time: 0.150129 Jun 03 09:12:29.058433 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 289/575] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:28 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:29.701679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:29.702205 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:29.708657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:29.709101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:29.709855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:29.710287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:29.836394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:29.844974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:29.846476 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:29.847622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e62671a9-6fbf-444f-baa3-2eee49701549 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.150422 Jun 03 09:12:29.848212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 287/576] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:29 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:30.075258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:30.075898 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:30.082389 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:30.082843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:30.083618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:30.084103 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:30.211205 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:30.218790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a649eee0-72ef-4152-82c0-78827181a8fb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1508 microversion: 2.1 time: 0.148082 Jun 03 09:12:30.219352 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 290/577] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:12:30 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:12:30.865553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:30.866161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:30.872979 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:30.873429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:30.874191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:30.874619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:31.016928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:31.025146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:31.027177 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:31.028368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4fbc8f09-eef5-44d5-abdc-e9556dce2792 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.166916 Jun 03 09:12:31.029178 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 288/578] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:30 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:32.048374 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:32.049123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:32.056114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:32.056544 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:32.057960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:32.058421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:32.193699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:32.201802 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:32.203313 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:32.204491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-80447f62-408c-4d6c-bcf7-f05c54e97fba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.160429 Jun 03 09:12:32.205051 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 291/579] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:32 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:33.222345 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:33.222951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:33.230059 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:33.230518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:33.231274 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:33.231711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:33.368443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:33.376998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:33.378513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:33.379659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6040b757-3da3-4a72-b09f-fb490033a201 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.161187 Jun 03 09:12:33.380241 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 289/580] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:33 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:34.397736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:34.398407 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:34.405176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:34.405623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:34.406402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:34.406837 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:34.540432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:34.548418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:34.549907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:34.551063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a53603ad-47dd-46cd-bf5f-53403b8b847c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.157287 Jun 03 09:12:34.551601 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 292/581] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:34 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:35.569398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:35.569990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:35.577443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:35.577902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:35.578697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:35.579135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:35.718432 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:35.726348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:35.727890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:35.729233 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bfbc0d8e-51c8-4780-b51d-8cf0a432f7c7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.163658 Jun 03 09:12:35.729947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 290/582] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:35 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:36.748464 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:36.749160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:36.755886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:36.756330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:36.757087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:36.757514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:36.891724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:36.899921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:36.901481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:36.905172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7d21f189-c939-4dc9-a06c-5c135ecd6a1f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.161278 Jun 03 09:12:36.905744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 293/583] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:36 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:37.924624 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:37.925308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:37.932377 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:37.932827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:37.933596 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:37.934028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:38.075538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:38.083398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:38.084912 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:38.086052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-20ef3fa3-8d0e-4a90-9f8d-08517b947942 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.165304 Jun 03 09:12:38.086639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 291/584] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:37 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:38.960382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-dc822ced-f3a6-4901-a113-b278563c4600 req-d9c80327-42dd-4004-9ee8-fc631083c92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "name": "network-vif-plugged", "status": "completed", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:38.970669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dc822ced-f3a6-4901-a113-b278563c4600 req-d9c80327-42dd-4004-9ee8-fc631083c92a service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:38.971145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-dc822ced-f3a6-4901-a113-b278563c4600 req-d9c80327-42dd-4004-9ee8-fc631083c92a service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:38.984610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-dc822ced-f3a6-4901-a113-b278563c4600 req-d9c80327-42dd-4004-9ee8-fc631083c92a service nova] Creating event network-vif-plugged:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:12:38.990081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-dc822ced-f3a6-4901-a113-b278563c4600 req-d9c80327-42dd-4004-9ee8-fc631083c92a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Jun 03 09:12:38.990682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 294/585] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:39.104814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:39.106110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:39.112897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:39.113336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:39.114089 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:39.114516 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:39.247724 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:39.251217 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:39.256921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:39.258444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:39.260105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-54088768-bf9c-4219-8533-f7b3ac2f9039 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.159731 Jun 03 09:12:39.260700 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 292/586] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:39 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:40.281634 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:40.282236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:40.288787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:40.289227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:40.289978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:40.290404 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:40.423242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:40.431748 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:40.433331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:40.434492 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a7e90bbf-5817-4f05-a0a3-ba61c6e6b49e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.157644 Jun 03 09:12:40.435054 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 295/587] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:40 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:41.454208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:41.454821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:41.462367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:41.462942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:41.463717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:41.464181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:41.598731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:41.607100 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:41.608627 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:41.609776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2d276f55-cb22-43bb-b6cf-55c8c9def780 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.160888 Jun 03 09:12:41.610335 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 293/588] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:41 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:42.629715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:42.630369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:42.637422 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:42.637843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:42.638600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:42.639025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:42.764763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:42.772751 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:42.774259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:42.775445 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dbbb1164-9d34-4b5d-8c06-36cbea3465d7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.149792 Jun 03 09:12:42.776037 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 296/589] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:42 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:43.793462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:43.794088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:43.800561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:43.801000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:43.801744 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:43.802191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:43.937169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:43.946101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:43.947527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:43.949319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-609b4bd3-63c9-43a9-a359-231fd30cb874 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1744 microversion: 2.20 time: 0.159192 Jun 03 09:12:43.949769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 294/590] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:43 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:44.971224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:44.971858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:44.978411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:44.978870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:44.979642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:44.980150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:45.111481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:45.119469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:45.121040 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:45.122197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ea2dadaa-e703-4d68-9377-4f52fbd4521d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.158281 Jun 03 09:12:45.122755 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 297/591] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:44 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:46.142558 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:46.143171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:46.150139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:46.150841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:46.151602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:46.152849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:46.310528 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:46.319370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:46.320908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:46.322101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ae39b53e-a18f-41e0-9c09-e456e1eae987 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.183722 Jun 03 09:12:46.322649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 295/592] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:46 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:12:47.344731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:47.345341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:47.352382 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:47.353003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:47.353588 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:47.354012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:47.496347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:47.504603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:47.506121 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:47.507268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb04ae09-9835-42bc-be55-983e1e1782ba tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.166474 Jun 03 09:12:47.507854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 298/593] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:47 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:48.526441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:48.527044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:48.529338 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:48.534826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:48.535267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:48.536043 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:48.536472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:48.701562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:48.710129 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:48.711643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:48.712852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fd61276e-6d7d-44da-94f7-44d9e9a66f61 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.190941 Jun 03 09:12:48.713519 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 296/594] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:48 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:49.730523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:49.731147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:49.733719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=41 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:49.739075 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:49.739522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:49.740317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:49.740752 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:49.743490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=99 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:49.894241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:49.902807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:49.904400 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:49.905553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ae7679cb-38cd-4d2d-8f60-bbb77e6c2c8a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.178955 Jun 03 09:12:49.906119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 299/595] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:49 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:50.924774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:50.925352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:50.932324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:50.933000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:50.934036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:50.935207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:51.072621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:51.080909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:51.082409 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:51.083859 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-90fa85a4-5966-435e-b508-8328f3b7f8cc tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.163131 Jun 03 09:12:51.090830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 297/596] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:50 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:52.102456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:52.103079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:52.111402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:52.111891 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:52.112670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:52.113108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:52.252515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:52.260834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:52.262350 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:52.263494 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8e4ff45f-b9e2-4da7-b24e-afac52c02452 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.165094 Jun 03 09:12:52.264105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 300/597] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:52 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:53.282574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:53.283893 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:53.291412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:53.292009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:53.293041 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:53.293732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:53.436921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:53.445082 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:53.446561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:53.447702 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4b6cf797-8b02-413e-8075-5a01d0048329 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.169895 Jun 03 09:12:53.448282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 298/598] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:53 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:54.466358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:54.466966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:54.473716 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:54.474164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:54.474930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:54.475369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:54.609198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:54.617840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:54.619341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:54.620542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb07395c-b8a2-4230-af4c-07bb95ca68e4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.158097 Jun 03 09:12:54.621479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 301/599] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:54 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:55.643169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:55.644134 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:55.653382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.654505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.655372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.655926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.801501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:55.809903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:55.811354 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:55.812613 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-052dbe53-f1d2-4dcd-bc6f-9c148edc3706 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.174908 Jun 03 09:12:55.813174 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 299/600] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:55 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:55.876401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:55.876970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:55.893932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.894671 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.895599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.896625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3c5abf7-e23e-4f72-b084-b3583b160752", "device": "/dev/sdb"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:55.897569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.898826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:55.906151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.906745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.907796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:55.908644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:55.924308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-87a30647-fec3-4112-85c1-9f6ecfb2c4d5 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/ips" status: 200 len: 144 microversion: 2.1 time: 0.052273 Jun 03 09:12:55.925470 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 302/601] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:12:55 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/ips => generated 144 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:56.251423 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-57302158-f7a4-4b66-aa59-39221a79dfcf tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "POST /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358086 Jun 03 09:12:56.256725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 300/602] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:12:55 2022] POST /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:56.831326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:56.831996 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:56.838088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:56.838540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:56.839301 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:56.839738 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:56.969487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:56.977652 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:56.979183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:56.980397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-79e72e85-edf9-4b05-9738-68d74c81b63d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.153141 Jun 03 09:12:56.980967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 303/603] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:56 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:12:57.374658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "785782d6-1cb7-4d63-ab7d-bfea872a5e4c"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:12:57.375890 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:57.386135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:57.386852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:57.388540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:57.389567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:57.664864 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7c04482e-96e5-45ee-9d64-635d30a0068d tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295009 Jun 03 09:12:57.665582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 301/604] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:12:57 2022] POST /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:12:57.999636 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:58.000529 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:58.007696 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:58.008255 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:58.009116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:58.009748 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:58.156128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:58.165488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:58.167025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:58.168254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9bd95db7-7e3f-40a3-a032-ad5e60f02187 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.173608 Jun 03 09:12:58.179027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 304/605] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:57 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:12:59.187661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:12:59.189284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:12:59.196440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:59.196959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:59.197723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:12:59.198149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:12:59.352833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:59.362692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:59.364426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:12:59.365722 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-04206686-9bf1-45ac-9d8b-1767a6da3dfd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.182837 Jun 03 09:12:59.366475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 302/606] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:12:59 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:00.384104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:00.384715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:00.391296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:00.391748 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:00.392533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:00.392972 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:00.523426 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:00.531446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:00.533134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:00.534677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c8310c8b-406b-4a02-b495-05bf053ec6af tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1739 microversion: 2.20 time: 0.154188 Jun 03 09:13:00.535326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 305/607] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:00 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:01.553748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:01.554357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:01.561532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:01.561980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:01.562747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:01.563182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:01.696316 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:01.704482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:01.705962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:01.707103 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b261d2f6-f599-475d-bafa-fe54d4ee5a6d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1721 microversion: 2.20 time: 0.157287 Jun 03 09:13:01.707647 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 303/608] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:01 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:02.725227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:02.725841 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:02.734038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:02.734493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:02.735268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:02.735707 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:02.876687 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:02.884648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:02.886155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:02.887297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-25383618-066b-4009-b14e-6f7631dd754e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1721 microversion: 2.20 time: 0.166029 Jun 03 09:13:02.887883 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 306/609] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:02 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:03.037658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-423124e2-1189-49f8-806c-e5b62ab51c4b req-3be64d4a-c2c9-421d-a2f9-42517a43051e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "name": "network-vif-unplugged", "status": "completed", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:03.046728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-423124e2-1189-49f8-806c-e5b62ab51c4b req-3be64d4a-c2c9-421d-a2f9-42517a43051e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:03.047053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-423124e2-1189-49f8-806c-e5b62ab51c4b req-3be64d4a-c2c9-421d-a2f9-42517a43051e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:03.058866 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-423124e2-1189-49f8-806c-e5b62ab51c4b req-3be64d4a-c2c9-421d-a2f9-42517a43051e service nova] Creating event network-vif-unplugged:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:13:03.065190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-423124e2-1189-49f8-806c-e5b62ab51c4b req-3be64d4a-c2c9-421d-a2f9-42517a43051e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031485 Jun 03 09:13:03.065855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 304/610] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:13:03.905796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:03.906405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:03.912884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:03.913335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:03.914100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:03.914532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.081468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:04.096799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:04.098308 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:04.099472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d955ea4b-42c6-4c95-b18e-d076d1671dcd tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1724 microversion: 2.20 time: 0.198103 Jun 03 09:13:04.100079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 307/611] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:03 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:04.124401 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ccb29ee-0eaf-46f0-a25f-ddc4cb72c852"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:04.125621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:04.132373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.132821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.133762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.134207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.328280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:04.424290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-76e6c700-267a-455c-bb1d-476d35726c08 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309808 Jun 03 09:13:04.424902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 305/612] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jun 3 09:13:04 2022] POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:13:04.553931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:04.554416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:04.560656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.561098 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.561846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.562273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.800497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-01c12bbc-1e6d-4355-ab7d-57c3724ffe3b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments/6ccb29ee-0eaf-46f0-a25f-ddc4cb72c852" status: 202 len: 0 microversion: 2.20 time: 0.250711 Jun 03 09:13:04.801085 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 308/613] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jun 3 09:13:04 2022] DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments/6ccb29ee-0eaf-46f0-a25f-ddc4cb72c852 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:13:04.857266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:04.857822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:04.867125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.867568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.868357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.868796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.959142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d5343bf4-3058-4058-95f3-59f6579d750f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/action" status: 202 len: 0 microversion: 2.20 time: 0.105951 Jun 03 09:13:04.959966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 306/614] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jun 3 09:13:04 2022] POST /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:13:04.968619 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:04.969522 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:04.976465 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.976904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:04.977667 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:04.978091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:05.116942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:05.125365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:05.126874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:05.128318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e711e7e0-3d94-4767-99b2-cb351a7522e7 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1672 microversion: 2.20 time: 0.164210 Jun 03 09:13:05.128878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 309/615] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:04 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:06.147188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:06.147820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:06.154719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:06.155162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:06.155953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:06.156390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:06.286049 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:06.295130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:06.296642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:06.297778 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5aca08e2-13a4-42c8-ab58-cc1ac6cf3de2 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1672 microversion: 2.20 time: 0.155165 Jun 03 09:13:06.298337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 307/616] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:06 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:07.316882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:07.317488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:07.323992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:07.324518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:07.325310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:07.326360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:07.451135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:07.459000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:07.460529 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:07.461659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a41666b7-87d2-436e-ab42-54f9ec4741c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1674 microversion: 2.20 time: 0.148687 Jun 03 09:13:07.462205 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 310/617] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:07 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:08.479657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:08.480294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:08.486827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:08.487278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:08.488058 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:08.488498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:08.631917 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:08.640964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:08.642651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:08.643824 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-af4179fe-785b-4ecc-bd17-c832a37fdc38 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1674 microversion: 2.20 time: 0.167945 Jun 03 09:13:08.644390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 308/618] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:08 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:09.662672 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:09.663312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:09.670446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:09.670892 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:09.671651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:09.672106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:09.811014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:09.819072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:09.820661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:09.821809 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4530dbe9-6d98-43bb-b650-9dd58c4b670f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.163273 Jun 03 09:13:09.822362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 311/619] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:09 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:10.840027 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:10.840635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:10.847131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:10.847581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:10.848433 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:10.848868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:10.982232 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:10.990315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:10.991820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:10.992995 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e5741554-7840-48a7-bfe3-eea240ac0db0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.156929 Jun 03 09:13:10.993551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 309/620] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:10 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:12.010646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:12.011257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:12.017834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:12.018272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:12.019026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:12.019458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:12.148315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:12.158460 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:12.160711 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:12.161904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-564bd9b6-b474-4f51-ac2b-749e07b33e64 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.155202 Jun 03 09:13:12.162553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 312/621] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:12 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:13.180721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:13.181331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:13.188020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:13.188475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:13.189235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:13.189673 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:13.320478 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:13.329125 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:13.330630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:13.331793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d9bdce57-501f-49da-b019-9d40d5308ad9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.154956 Jun 03 09:13:13.332361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 310/622] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:13 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:14.349349 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:14.350705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:14.358323 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.358776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.359552 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.360026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.382852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:14.496539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:14.504732 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:14.506239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:14.507419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-00fe859a-8c75-419c-8df8-bea45dad89d3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.162193 Jun 03 09:13:14.508014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 313/623] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:14 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:14.729355 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:14.730989 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:14.738122 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.738838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.739892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.740440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.815747 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8466403c-3b5b-4101-88b1-0320328a06b0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087073 Jun 03 09:13:14.828542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:14.829317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:14.833758 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 311/624] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:13:14 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:14.838325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.840402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.841963 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:14.843746 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:14.897834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-852ebf94-02c1-4694-a1c1-6c9f76b6e245 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c" status: 200 len: 194 microversion: 2.1 time: 0.074062 Jun 03 09:13:14.899790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 314/625] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 09:13:14 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:15.526654 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:15.527295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:15.542096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:15.542552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:15.543343 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:15.543791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:15.715938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:15.724555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:15.726436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:15.727887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cca5ee30-92a1-41ce-8483-f7041403f9b8 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.205287 Jun 03 09:13:15.738860 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 312/626] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:15 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:16.746257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:16.746855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:16.753972 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:16.754411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:16.755182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:16.755591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:16.895119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:16.903294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:16.904819 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:16.905988 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-57f31e92-6a19-4ba7-a7a8-dce5de487f96 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.163635 Jun 03 09:13:16.906533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 315/627] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:16 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:17.923802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:17.924440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:17.930855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:17.931301 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:17.932076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:17.932514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:18.079070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:18.088661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:18.090471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:18.092334 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf00e7ad-4870-4478-95d5-adb3d3c04633 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.171840 Jun 03 09:13:18.093387 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 313/628] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:17 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:19.110945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:19.111767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:19.118347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:19.118799 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:19.119571 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:19.120041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:19.259896 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:19.268370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:19.269879 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:19.271033 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-514e5637-2e98-4313-8e28-e4b81d037871 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.164414 Jun 03 09:13:19.271591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 316/629] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:19 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:20.289992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:20.290594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:20.292896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=38 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:20.298104 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:20.298540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:20.299292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:20.299722 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:20.425714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:20.433561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:20.435060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:20.436855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ed16dfa3-774c-417c-8ca1-5010f7f5110c tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.150153 Jun 03 09:13:20.437413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 314/630] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:20 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:21.455023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:21.455627 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:21.458087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=36 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:21.463876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:21.464327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:21.465084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:21.465519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:21.594289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:21.602246 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:21.603774 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:21.604904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-260bbdb0-59c9-45b5-9604-8c7d0856fc0f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.154332 Jun 03 09:13:21.605448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 317/631] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:21 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:22.622455 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:22.623103 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:22.630336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:22.630788 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:22.631547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:22.632014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:22.770833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:22.778988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:22.781143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:22.782283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6f1ad385-c5f5-4abe-924c-cdb76c5ed234 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.163885 Jun 03 09:13:22.793200 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 315/632] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:22 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:23.651997 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d58b7a4-5f52-4a0b-bdd9-beff291b2cc7"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:23.653147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:23.660550 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:23.661003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:23.661773 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:23.662213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:23.800553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:23.801155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:23.808187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:23.808637 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:23.809398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:23.809836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:23.944116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:23.955399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:23.957211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:23.958370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-db78d957-2489-44e8-9bf9-23200335d3f6 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.162433 Jun 03 09:13:23.958920 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 316/633] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:23 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:24.978175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:24.979878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:24.987682 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:24.988408 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:24.991681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:24.992463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:25.132854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:25.141531 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:25.143029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:25.144224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-24c950fc-a2aa-48ff-9e0f-d25693ca6f92 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.169990 Jun 03 09:13:25.144783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 317/634] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:24 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:26.162736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:26.163468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:26.169544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:26.170001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:26.170751 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:26.171177 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:26.315080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:26.324267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:26.325847 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:26.327010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f1b47398-c461-4914-bb35-350845b0f895 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.168435 Jun 03 09:13:26.331803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 318/635] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:26 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:26.371186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:26.371680 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:26.377767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:26.378213 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:26.378964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:26.379406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:26.462962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lazy-loading 'services' on Instance uuid 6b8c2993-0afa-4e6a-9a51-e1917beb477b {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:13:26.529602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:26.544957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-07c437d0-35eb-4f41-8cc4-9812bd3a5b3b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b/os-volume_attachments/d3c5abf7-e23e-4f72-b084-b3583b160752" status: 202 len: 0 microversion: 2.1 time: 0.177325 Jun 03 09:13:26.550030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 319/636] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:13:26 2022] DELETE /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b/os-volume_attachments/d3c5abf7-e23e-4f72-b084-b3583b160752 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 09:13:27.348385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:27.350196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:27.358460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:27.358916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:27.360226 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:27.360667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:27.498295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:27.506299 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:27.507833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:27.508982 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f201bdba-538b-475d-b294-b68e9403e730 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.166116 Jun 03 09:13:27.509565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 320/637] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:27 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:28.527035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:28.527895 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:28.534796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:28.535243 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:28.536047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:28.536488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:28.664155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:28.674259 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:28.676085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:28.677544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c70e535c-43c6-4ce6-9c34-146472f18038 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.154361 Jun 03 09:13:28.680352 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 321/638] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:28 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:29.705703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:29.706441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:29.712838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:29.713290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:29.714052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:29.714491 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:29.855616 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:29.863493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:29.865007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:29.866130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-074fd07e-268d-47be-9c1f-624777679c10 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.164827 Jun 03 09:13:29.866685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 322/639] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:29 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:30.885332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:30.886312 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:30.893011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:30.893466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:30.894267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:30.894700 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:31.036254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:31.049756 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:31.051743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:31.053214 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f74136a5-7a92-44c5-ae22-d94f06d56324 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.172137 Jun 03 09:13:31.054036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 323/640] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:30 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:32.073529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:32.074246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:32.080545 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:32.080988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:32.081735 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:32.082161 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:32.214732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:32.223085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:32.224717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:32.225861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1f2ee585-a20b-4dba-9e14-02ff7b64aa89 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.156260 Jun 03 09:13:32.226415 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 324/641] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:32 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:33.244756 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:33.245489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:33.252332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:33.252781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:33.253538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:33.253973 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:33.545761 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:33.554486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:33.556011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:33.557166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6ee25301-e388-4394-851b-4f57da9bd6b4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.316408 Jun 03 09:13:33.557721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 325/642] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:33 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:33.659965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:33.737968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=32 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:34.574420 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:34.575017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:34.582376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:34.582820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:34.583579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:34.584038 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:34.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:34.720551 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:34.722039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:34.723182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c01e2e63-f955-4baf-9cb6-6f375100c1fb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.152665 Jun 03 09:13:34.723775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 326/643] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:34 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:35.741266 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:35.741946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:35.748644 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:35.749091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:35.749849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:35.750287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:35.880252 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:35.888233 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:35.889727 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:35.890867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2c84efd5-9c50-4812-bd6f-769eba804e0b tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.153489 Jun 03 09:13:35.892087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 327/644] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:35 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:36.910556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:36.911194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:36.917557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:36.917998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:36.918745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:36.919171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:37.049773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:37.057706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:37.059204 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:37.060371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-735c65ab-a529-45a5-83a7-b90b6a98677f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.154680 Jun 03 09:13:37.060918 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 328/645] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:36 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:37.383659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7c585f2c-854f-4fd8-bc79-4d5c99770533 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "POST /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.735502 Jun 03 09:13:37.384315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 318/646] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:13:23 2022] POST /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 194 bytes in 13737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:38.078070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:38.078686 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:38.086040 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.086495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.087269 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.087710 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.215439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:38.223882 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:38.225380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:38.226554 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-370473c9-72d8-4dea-a240-f4cd6f72d8e1 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.152714 Jun 03 09:13:38.227098 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 329/647] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:38 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:38.310142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:38.310669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:38.317017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.317362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.318114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.318543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.343944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:13:38.429104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c957083-5573-47df-a6bb-25dde6f1926c tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 204 len: 0 microversion: 2.1 time: 0.123298 Jun 03 09:13:38.429758 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 319/648] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:13:38 2022] DELETE /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:13:38.438471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:38.439246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:38.445507 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.445957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.446809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:38.447155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:38.585797 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:38.593164 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-515c90b3-13f0-4972-b493-0b2150c07f2a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1514 microversion: 2.1 time: 0.158856 Jun 03 09:13:38.593716 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 330/649] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:38 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:39.245959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:39.246557 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:39.253506 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:39.253950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:39.254705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:39.255130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:39.389318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:39.397341 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:39.398843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:39.400031 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-590c1147-25e2-41ef-b955-93e9a5e53c95 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.158453 Jun 03 09:13:39.400680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 320/650] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:39 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:39.611521 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:39.612155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:39.618571 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:39.619017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:39.619788 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:39.620221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:39.754441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:39.761947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e2a9498f-e45b-465c-8d07-0f8eeef947fd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1514 microversion: 2.1 time: 0.154782 Jun 03 09:13:39.762610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 331/651] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:39 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:40.418327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:40.418942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:40.425396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:40.425842 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:40.426603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:40.427044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:40.558180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:40.566752 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:40.568260 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:40.569432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f861c50a-c4ce-4125-8571-ef9bb805f5ed tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.154971 Jun 03 09:13:40.569954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 321/652] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:40 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:40.778575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:40.779190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:40.786216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:40.786670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:40.787563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:40.787705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-3d1ffe9d-acec-4179-bfca-c77a70b99d7b req-2793e0d5-cba5-42ec-963b-67f68934846f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "name": "network-vif-plugged", "status": "completed", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:40.788207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:40.796092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3d1ffe9d-acec-4179-bfca-c77a70b99d7b req-2793e0d5-cba5-42ec-963b-67f68934846f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:40.796534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-3d1ffe9d-acec-4179-bfca-c77a70b99d7b req-2793e0d5-cba5-42ec-963b-67f68934846f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:40.810230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-3d1ffe9d-acec-4179-bfca-c77a70b99d7b req-2793e0d5-cba5-42ec-963b-67f68934846f service nova] Creating event network-vif-plugged:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:13:40.816409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-3d1ffe9d-acec-4179-bfca-c77a70b99d7b req-2793e0d5-cba5-42ec-963b-67f68934846f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Jun 03 09:13:40.817041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 322/653] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:40.937427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:40.945615 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cf06f944-a79c-4b7a-b1d7-ed6f669e04e3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1514 microversion: 2.1 time: 0.170967 Jun 03 09:13:40.946186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 332/654] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:40 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:41.595631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:41.596259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:41.605263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.605438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.606213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.606648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.715117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e1e78e3b-7472-4d35-b772-92263699a3ed req-a48ff3e5-a206-40fa-84fd-44c8a71b21ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8c2993-0afa-4e6a-9a51-e1917beb477b", "name": "network-vif-deleted", "tag": "450485c6-ee44-40dc-8dac-375e896665be"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:41.723554 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e1e78e3b-7472-4d35-b772-92263699a3ed req-a48ff3e5-a206-40fa-84fd-44c8a71b21ac service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.724105 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e1e78e3b-7472-4d35-b772-92263699a3ed req-a48ff3e5-a206-40fa-84fd-44c8a71b21ac service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.735170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e1e78e3b-7472-4d35-b772-92263699a3ed req-a48ff3e5-a206-40fa-84fd-44c8a71b21ac service nova] Creating event network-vif-deleted:450485c6-ee44-40dc-8dac-375e896665be for instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b on hv-cinder-81268 Jun 03 09:13:41.741406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e1e78e3b-7472-4d35-b772-92263699a3ed req-a48ff3e5-a206-40fa-84fd-44c8a71b21ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029846 Jun 03 09:13:41.742045 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 333/655] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:41.755279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:41.763387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:41.765002 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:41.766173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-485c9b58-5709-4f56-8a54-7c961bdcf4c0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.176131 Jun 03 09:13:41.767363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 323/656] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:41 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:41.769576 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:41.771400 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:41.780232 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.781018 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.781730 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.782274 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.816336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-223dcde3-7669-47fc-a48c-44c5c4e7826e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051916 Jun 03 09:13:41.816887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 334/657] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:13:41 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:13:41.924573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:41.924984 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:41.930879 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.931327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.932104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.932544 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.961596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d09d4d18-d81b-4c0d-9bf8-c1d13a3d3c2e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c" status: 200 len: 194 microversion: 2.1 time: 0.041106 Jun 03 09:13:41.962349 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 324/658] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 09:13:41 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:41.962464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:41.962921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:41.969441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.969887 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.970690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.971128 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.971981 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:41.972488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:41.978350 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.978791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:41.979543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:41.980003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:42.002504 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:42.002954 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:42.003428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lazy-loading 'fault' on Instance uuid 6b8c2993-0afa-4e6a-9a51-e1917beb477b {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:13:42.044549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:42.052141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c28d163d-3a2d-4d92-8b0f-b5e8e3dc8cbc tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 200 len: 1309 microversion: 2.1 time: 0.093498 Jun 03 09:13:42.052755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 335/659] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:41 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:13:42.061150 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lazy-loading 'services' on Instance uuid 6e646c4e-c937-4f0c-8c9c-14af8df51a07 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:13:42.137293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-359b123a-c7e4-4dab-8fd9-5afd4b3de020 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c" status: 202 len: 0 microversion: 2.1 time: 0.168928 Jun 03 09:13:42.138345 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 325/660] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:13:41 2022] DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/785782d6-1cb7-4d63-ab7d-bfea872a5e4c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 09:13:42.786078 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:42.786681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:42.793106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:42.793548 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:42.794296 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:42.794721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:42.924691 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:42.928172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:42.933685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:42.935239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:42.936417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4bd90f55-8339-4031-82f5-ffc4b255f9f3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.155053 Jun 03 09:13:42.936971 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 336/661] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:42 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:43.070173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:43.070862 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: 6b8c2993-0afa-4e6a-9a51-e1917beb477b] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:43.077554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:43.077992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:43.079278 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:43.079710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:43.092706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] HTTP exception thrown: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Request method failure captured: Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b HTTP/1.1 Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdBw5n2IDAykkZed2-SQZHgyiSiRVCd60qYLXrf8O79aMcgh3po4jhtleguD8v6aX4ywntut35hGVmlTLoguSpjqGYmWmJRnuIqG_JK8GMpd894rWDOWhrYp2O6I7JFYmRWGl9snAv0hJQBbCCpA9GAS1E-h-vsd8Yocf2PB7NX8Sag Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 550b6a4abd9342caa18f150846d0277d Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:13:43.095906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_550b6a4abd9342caa18f150846d0277d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 550b6a4abd9342caa18f150846d0277d Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotTestJSON-1495270933-project Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 544a8ed11787431db393494eefcba2e6 Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotTestJSON-1495270933-project Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. Jun 03 09:13:43.097343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '6b8c2993-0afa-4e6a-9a51-e1917beb477b'} Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:13:43.099800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. Jun 03 09:13:43.101284 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:43.102648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Returning 404 to user: Instance 6b8c2993-0afa-4e6a-9a51-e1917beb477b could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:13:43.102648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-397aeeaf-39f1-4a66-b119-bae3cd6bfd55 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b" status: 404 len: 111 microversion: 2.1 time: 0.031500 Jun 03 09:13:43.102648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 326/662] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:43 2022] GET /compute/v2.1/servers/6b8c2993-0afa-4e6a-9a51-e1917beb477b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:13:43.954759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:43.955283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:43.961796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:43.962675 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:43.963444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:43.963908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:44.090680 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:44.098949 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:44.100466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:44.101598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1c12cddd-ef5a-4f40-bf94-92648c079946 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.151043 Jun 03 09:13:44.102145 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 337/663] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:43 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:45.120312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:45.120924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:45.128227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:45.128673 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:45.129432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:45.129868 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:45.262413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:45.270376 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:45.271884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:45.273026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c93f6cff-1880-408b-a9d4-247f702b4fce tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1730 microversion: 2.20 time: 0.156679 Jun 03 09:13:45.273580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 327/664] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:45 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:13:46.291314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:46.291965 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:46.298608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:46.299056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:46.299848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:46.300284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:46.436492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:46.444731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:46.446223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:46.447359 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5b1a7f49-8a87-45fd-a250-4d3b2e8ca58f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1717 microversion: 2.20 time: 0.160020 Jun 03 09:13:46.447934 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 338/665] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:13:46 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:13:48.538337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:48.538964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:48.545632 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:48.545988 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:48.546853 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:48.547176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:48.575807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-05475ea1-e5f8-4ee7-84a1-5eacb2c89efb tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/4d58b7a4-5f52-4a0b-bdd9-beff291b2cc7" status: 200 len: 194 microversion: 2.1 time: 0.042475 Jun 03 09:13:48.576397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 328/666] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jun 3 09:13:48 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/4d58b7a4-5f52-4a0b-bdd9-beff291b2cc7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:48.586597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:48.587155 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:48.594919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:48.595391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:48.596196 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:48.596633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:48.683597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lazy-loading 'services' on Instance uuid 6e646c4e-c937-4f0c-8c9c-14af8df51a07 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:13:48.757654 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-db07c3d9-6110-4f13-a349-1118158e3ec4 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/4d58b7a4-5f52-4a0b-bdd9-beff291b2cc7" status: 202 len: 0 microversion: 2.1 time: 0.174335 Jun 03 09:13:48.758424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 339/667] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:13:48 2022] DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments/4d58b7a4-5f52-4a0b-bdd9-beff291b2cc7 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:13:49.929927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:49.930927 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:49.937091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:49.937535 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:49.938330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:49.939457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:49.967210 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa4c75cc-2434-4df1-ba6a-e07812e2c678 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041250 Jun 03 09:13:49.967775 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 329/668] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:13:49 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:13:50.071323 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:50.072425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:50.079083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.079527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.080325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.080762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.108900 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dd5edf8a-c665-41b4-87d1-82eb32b6cfa6 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041888 Jun 03 09:13:50.109441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 340/669] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:13:50 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:13:50.165500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:50.166000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:50.171959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.172410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.173836 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.174268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.198102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:13:50.274229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ace4744d-2b69-488c-b676-afa78f79c491 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 204 len: 0 microversion: 2.1 time: 0.112137 Jun 03 09:13:50.274845 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 330/670] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:13:50 2022] DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:13:50.283970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:50.284581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:50.290605 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.291061 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.291873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:50.292314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:50.424712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:50.432121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c6ba49fe-7ef6-4b6d-888e-79425588208c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1667 microversion: 2.1 time: 0.152944 Jun 03 09:13:50.432683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 341/671] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:50 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:51.449681 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:51.450372 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:51.456859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:51.457299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:51.458052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:51.458482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:51.476504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:51.587520 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:51.595439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b1ef5b5e-0c20-4579-82f2-e1e8475ed8a0 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1667 microversion: 2.1 time: 0.149981 Jun 03 09:13:51.596031 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 331/672] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:51 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:52.613189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:52.613815 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:52.616342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=58 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:52.621734 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:52.622188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:52.623071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:52.623523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:52.750754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:52.758742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-03985666-6ec5-4d85-9dfa-e423d7076caf tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1667 microversion: 2.1 time: 0.150047 Jun 03 09:13:52.759309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 342/673] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:52 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:53.774992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:53.775511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:53.782149 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:53.782596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:53.783358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:53.784082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:53.914076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:53.921556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2fcd4759-b398-42cc-92e7-8436b82d70fc tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1667 microversion: 2.1 time: 0.150477 Jun 03 09:13:53.930058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 332/674] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:53 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:53.946897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-427818518", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "networks": [{"uuid": "f161c96f-8fee-4fc4-858a-a2d1cf09a892"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:53.998670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] validate_networks() for [('f161c96f-8fee-4fc4-858a-a2d1cf09a892', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:13:54.335900 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:13:54.336315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:13:54.336781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:13:54.337179 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:13:54.337580 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:13:54.346417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:54.346858 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:54.347635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:54.348101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:54.364750 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Getting quotas for project 550b6a4abd9342caa18f150846d0277d. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:13:54.368628 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Getting quotas for user 544a8ed11787431db393494eefcba2e6 and project 550b6a4abd9342caa18f150846d0277d. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:13:54.379825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:13:54.382020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:13:54.426776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b268e61d-11e9-406f-a81f-77ed5dd156f3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483731 Jun 03 09:13:54.427443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 343/675] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 09:13:54.437388 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d505612c-67fa-4cc2-92b8-39a1d11eac51 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:54.438123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d505612c-67fa-4cc2-92b8-39a1d11eac51 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:54.490243 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d505612c-67fa-4cc2-92b8-39a1d11eac51 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:54.498608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d505612c-67fa-4cc2-92b8-39a1d11eac51 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1218 microversion: 2.1 time: 0.065118 Jun 03 09:13:54.500232 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 333/676] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:54 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:54.942406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:54.943483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:54.950257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:54.951391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:54.952211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:54.952822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:55.099365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7b71aa00454406ab83a4891a8a719e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e442ff861b14d6492a4b27899632a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:55.107333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-2aca2795-858e-413a-b1a7-8940aaaf2933 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 200 len: 1667 microversion: 2.1 time: 0.169479 Jun 03 09:13:55.107939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 344/677] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:54 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:13:55.376059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-360f0299-de6a-4bc5-a127-5063f7b6f03b req-14fce661-9368-4b12-926e-3c149cd30bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c4e-c937-4f0c-8c9c-14af8df51a07", "name": "network-vif-deleted", "tag": "990c56c1-914b-454b-9464-f7e9f360f493"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:55.390412 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-360f0299-de6a-4bc5-a127-5063f7b6f03b req-14fce661-9368-4b12-926e-3c149cd30bd3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:55.390850 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-360f0299-de6a-4bc5-a127-5063f7b6f03b req-14fce661-9368-4b12-926e-3c149cd30bd3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:55.413773 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-360f0299-de6a-4bc5-a127-5063f7b6f03b req-14fce661-9368-4b12-926e-3c149cd30bd3 service nova] Creating event network-vif-deleted:990c56c1-914b-454b-9464-f7e9f360f493 for instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 on hv-cinder-81268 Jun 03 09:13:55.419678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-360f0299-de6a-4bc5-a127-5063f7b6f03b req-14fce661-9368-4b12-926e-3c149cd30bd3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047327 Jun 03 09:13:55.421039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 334/678] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:55.516879 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:55.518279 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:55.530718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:55.531797 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:55.532759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:55.537428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:55.660193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:55.668987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-60846f3c-b6db-4298-aa52-e9b3c1798ad5 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1288 microversion: 2.1 time: 0.156080 Jun 03 09:13:55.670080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 345/679] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:55 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1288 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:56.126493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:56.129639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:56.150929 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:56.152363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:56.153283 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:56.153831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:56.170055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 HTTP/1.1 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:13:56.171890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:13:56.173271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '6e646c4e-c937-4f0c-8c9c-14af8df51a07'} Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:13:56.174675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:13:56.176847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:13:56.180287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:13:56.180287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0d51e74f-23bf-4a2b-8450-5076b226864b tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 404 len: 111 microversion: 2.1 time: 0.051891 Jun 03 09:13:56.183816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-147fccd0-2df9-4df6-ba51-16e538137444 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '.version_select at 0x7fd2b12e7430>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:56.187417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR oslo.messaging._drivers.impl_rabbit [None req-147fccd0-2df9-4df6-ba51-16e538137444 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [5077ab01-13c4-40c4-90f3-b67a42e9cf7a] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 09:13:56.188451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 335/680] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:56 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:13:56.686694 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:56.687333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:56.694222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:56.694669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:56.695430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:56.695897 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:56.902019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:56.910115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8922f1a7-08df-4f45-84d5-cd5c296a9b19 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.227237 Jun 03 09:13:56.910723 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 336/681] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:56 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:13:57.197310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [None req-147fccd0-2df9-4df6-ba51-16e538137444 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [5077ab01-13c4-40c4-90f3-b67a42e9cf7a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41516. Jun 03 09:13:57.228420 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-147fccd0-2df9-4df6-ba51-16e538137444 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46577685" status: 202 len: 0 microversion: 2.1 time: 1.048921 Jun 03 09:13:57.229354 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 346/682] 10.222.0.61 () {58 vars in 1214 bytes} [Fri Jun 3 09:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46577685 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:13:57.266229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-edf8df8c-9f6a-42a8-abfc-c79e4e2edbe9 req-adf4c1c0-08ef-4b81-b749-eb4424606886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de0ed531-4475-4b81-a823-2de95394c347", "tag": "23a989f6-4f8b-47ee-b9cc-9590b1ae1440"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:13:57.275414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-edf8df8c-9f6a-42a8-abfc-c79e4e2edbe9 req-adf4c1c0-08ef-4b81-b749-eb4424606886 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:57.275910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-edf8df8c-9f6a-42a8-abfc-c79e4e2edbe9 req-adf4c1c0-08ef-4b81-b749-eb4424606886 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:57.289058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-edf8df8c-9f6a-42a8-abfc-c79e4e2edbe9 req-adf4c1c0-08ef-4b81-b749-eb4424606886 service nova] Creating event network-changed:23a989f6-4f8b-47ee-b9cc-9590b1ae1440 for instance de0ed531-4475-4b81-a823-2de95394c347 on hv-cinder-81268 Jun 03 09:13:57.294009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-edf8df8c-9f6a-42a8-abfc-c79e4e2edbe9 req-adf4c1c0-08ef-4b81-b749-eb4424606886 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101026 Jun 03 09:13:57.294663 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 337/683] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:13:57.927888 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:57.928509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:57.935632 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:57.936082 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:57.936850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:57.937436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:58.109891 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:58.117929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7edfc0ef-d08c-45d9-9d19-0a518548223b tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.194966 Jun 03 09:13:58.118513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 347/684] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:57 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:13:59.135988 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:13:59.136721 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:13:59.143371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:59.143859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:59.144634 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:13:59.145069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:13:59.292783 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:13:59.303595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-78972170-1073-4fae-9d60-2375fc5144f2 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.171740 Jun 03 09:13:59.313278 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 338/685] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:13:59 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:00.320060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:00.320719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:00.328827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.329280 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.330101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.330586 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.351892 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:00.352496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:00.359222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.359685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.360497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.361438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.375171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 HTTP/1.1 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:00.377531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.378911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '6e646c4e-c937-4f0c-8c9c-14af8df51a07'} Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:00.380060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.381603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.383569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:00.383569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9da8234f-ebd0-4b17-98ec-8d22eacfdaac tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 404 len: 111 microversion: 2.1 time: 0.031038 Jun 03 09:14:00.383569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 339/686] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:14:00 2022] DELETE /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 09:14:00.387208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:00.387859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 6e646c4e-c937-4f0c-8c9c-14af8df51a07] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:00.393999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.394459 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.395226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:00.395667 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:00.409925 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 HTTP/1.1 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:00.411592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.413145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '6e646c4e-c937-4f0c-8c9c-14af8df51a07'} Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:00.413913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. Jun 03 09:14:00.417170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:00.420292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 6e646c4e-c937-4f0c-8c9c-14af8df51a07 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:00.420292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-480770ad-4633-4d6d-9940-e354bb3fe00e tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07" status: 404 len: 111 microversion: 2.1 time: 0.029454 Jun 03 09:14:00.420292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 340/687] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:00 2022] GET /compute/v2.1/servers/6e646c4e-c937-4f0c-8c9c-14af8df51a07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:00.564513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:00.572898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-da058854-9687-4a8c-9be4-791428dfb45a tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.256530 Jun 03 09:14:00.573380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 348/688] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:00 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:01.571064 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:01.571554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:01.578009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.578454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.579206 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.579691 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.588704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:01.589320 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:01.593076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 HTTP/1.1 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:01.594613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.596106 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '66adb02f-314e-4e7b-bd15-d3a2674cfd38'} Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:01.596966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.598688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.600449 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:01.600538 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.600626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c9835647-4db5-4631-a58e-1561a2e56213 tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 404 len: 111 microversion: 2.1 time: 0.028774 Jun 03 09:14:01.600743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.600835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 341/689] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:14:01 2022] DELETE /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:01.600921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.600921 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.604004 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:01.604611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] [instance: 66adb02f-314e-4e7b-bd15-d3a2674cfd38] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:01.610463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.611394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.612177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:01.612613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:01.625854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] HTTP exception thrown: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Request method failure captured: Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 HTTP/1.1 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6nKaemlv0yeezakqCTcUiYxrtFtJwqxivrboNIKCLelxC2TULAgg3h8rlugkkPcOZm0MYv9bKPD3DQkDuqmsbB_EmqiI8aomgYSbTlwZBuGXP_WY_Z1ehhDWRc_ZdR5QSqd4aZzhXCfG2k_8Dc0Z-rGDY1LkH-XyoTFUPrIvMpcQg Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:01.628116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8e442ff861b14d6492a4b27899632a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8e442ff861b14d6492a4b27899632a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8e442ff861b14d6492a4b27899632a92 Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1803583247 Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 4a7b71aa00454406ab83a4891a8a719e Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeTestJSON-1803583247-project Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.629854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '66adb02f-314e-4e7b-bd15-d3a2674cfd38'} Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:01.630695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. Jun 03 09:14:01.641762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:01.647095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] Returning 404 to user: Instance 66adb02f-314e-4e7b-bd15-d3a2674cfd38 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:01.647095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-208926e3-8141-4f0c-b89c-d5c2ab3ab18c tempest-AttachVolumeTestJSON-1803583247 tempest-AttachVolumeTestJSON-1803583247-project] 10.222.0.61 "GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38" status: 404 len: 111 microversion: 2.1 time: 0.029060 Jun 03 09:14:01.647095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 342/690] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:01 2022] GET /compute/v2.1/servers/66adb02f-314e-4e7b-bd15-d3a2674cfd38 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 09:14:01.735627 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:01.743623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9d681239-01f3-4be8-b90b-936b07008f91 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.158784 Jun 03 09:14:01.744220 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 349/691] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:01 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:14:02.760179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:02.760882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:02.767722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:02.768299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:02.769140 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:02.769640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:02.915523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:02.924492 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a5572c5-14f7-4d64-a422-61c111337ecd tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.167499 Jun 03 09:14:02.925083 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 343/692] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:02 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:03.069208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-886423f9-8e0c-4eda-b336-633ba6ae0db7 req-79ee9e23-9653-4191-912c-0fb7f6083aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0ed531-4475-4b81-a823-2de95394c347", "name": "network-vif-plugged", "status": "completed", "tag": "23a989f6-4f8b-47ee-b9cc-9590b1ae1440"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:03.078276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-886423f9-8e0c-4eda-b336-633ba6ae0db7 req-79ee9e23-9653-4191-912c-0fb7f6083aa6 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:03.078722 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-886423f9-8e0c-4eda-b336-633ba6ae0db7 req-79ee9e23-9653-4191-912c-0fb7f6083aa6 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:03.090512 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-886423f9-8e0c-4eda-b336-633ba6ae0db7 req-79ee9e23-9653-4191-912c-0fb7f6083aa6 service nova] Creating event network-vif-plugged:23a989f6-4f8b-47ee-b9cc-9590b1ae1440 for instance de0ed531-4475-4b81-a823-2de95394c347 on hv-cinder-81268 Jun 03 09:14:03.096164 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-886423f9-8e0c-4eda-b336-633ba6ae0db7 req-79ee9e23-9653-4191-912c-0fb7f6083aa6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030173 Jun 03 09:14:03.096757 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 350/693] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:14:03.941962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:03.942501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:03.946142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:03.950219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:03.950663 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:03.951455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:03.951919 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:04.093818 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:04.101334 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9f8b1706-b0f3-46dd-996b-4271db487118 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1318 microversion: 2.1 time: 0.163948 Jun 03 09:14:04.101899 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 344/694] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:03 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:05.116013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:05.117529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:05.121872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:05.122876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:05.136427 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:05.138147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:05.139051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:05.139728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:05.280950 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:05.289284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-23be41d1-2c34-4722-b6fe-8ab40d9f5d4f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1506 microversion: 2.1 time: 0.174931 Jun 03 09:14:05.289896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 351/695] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:05 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:05.306888 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02075a98-2115-491c-b76b-ecb1197f4a98", "device": "/dev/sdb"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:05.308511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:05.310351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:05.317669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:05.318125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:05.319001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:05.319779 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:05.749560 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b3c217d9-96fd-4ed8-8170-5978ca6c74f9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "POST /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446896 Jun 03 09:14:05.750171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 345/696] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:14:05 2022] POST /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:06.056440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-51cf53b3-1a33-48a5-98c6-23fd3cf2df07 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Action: 'create', calling method: .version_select at 0x7fd2b1233310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1854011649"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:06.361380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-51cf53b3-1a33-48a5-98c6-23fd3cf2df07 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.429471 Jun 03 09:14:06.362191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 352/697] 10.222.0.61 () {60 vars in 1154 bytes} [Fri Jun 3 09:14:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 09:14:06.373404 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f3ac0571-07a3-4dc8-905f-8f5fa367a2e4 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b11a0ca0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:06.423970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f3ac0571-07a3-4dc8-905f-8f5fa367a2e4 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 200 len: 345 microversion: 2.1 time: 0.053863 Jun 03 09:14:06.424618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 346/698] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:06 2022] GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:07.436602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-537f9afc-d2b7-491b-b736-49ee876f7dbe tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b12a9550>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:07.483047 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-537f9afc-d2b7-491b-b736-49ee876f7dbe tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 200 len: 346 microversion: 2.1 time: 0.050759 Jun 03 09:14:07.483619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 353/699] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:07 2022] GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:07.494949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8bfacaf0-dbe3-425b-9ab6-3ae40aa62eda tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Action: 'create', calling method: .version_select at 0x7fd2b134ce50>, body: {"snapshot": {"volume_id": "d850f115-e29f-487c-801f-4e1e09b3fa18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-206194611"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:07.642790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8bfacaf0-dbe3-425b-9ab6-3ae40aa62eda tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152087 Jun 03 09:14:07.643604 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 347/700] 10.222.0.61 () {60 vars in 1161 bytes} [Fri Jun 3 09:14:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:07.653265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3175a00b-55be-4982-91f4-eb78528a7b60 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b12a9e50>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:07.685433 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3175a00b-55be-4982-91f4-eb78528a7b60 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.035902 Jun 03 09:14:07.686048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 354/701] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:07 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:07.696711 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5b947111-a7aa-4f11-957f-d0fdc09b0fdb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b119d8b0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:07.725144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5b947111-a7aa-4f11-957f-d0fdc09b0fdb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032243 Jun 03 09:14:07.725692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 348/702] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jun 3 09:14:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:07.735465 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6111b33c-d34e-4099-b1bf-a2d97132c74d tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b124f700>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:07.765057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6111b33c-d34e-4099-b1bf-a2d97132c74d tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.033289 Jun 03 09:14:07.765621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 355/703] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:07 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:08.777806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-21b15aa2-100d-437a-b689-c90460fa3d73 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b12490d0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:08.806260 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-21b15aa2-100d-437a-b689-c90460fa3d73 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.032766 Jun 03 09:14:08.806871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 349/704] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:08 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:09.819126 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-91a41774-af2d-4d90-8cf9-dd0da3fe3b8c tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b128a3a0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:09.848969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-91a41774-af2d-4d90-8cf9-dd0da3fe3b8c tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.034731 Jun 03 09:14:09.849562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 356/705] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:09 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:10.861132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1379072-cab1-4f70-8960-f7b685682421 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b122c4c0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:10.890643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d1379072-cab1-4f70-8960-f7b685682421 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.033802 Jun 03 09:14:10.891212 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 350/706] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:10 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:11.902964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-05b1b543-76f7-4d87-afcc-b850600bca46 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b12a91f0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:11.932874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-05b1b543-76f7-4d87-afcc-b850600bca46 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.034198 Jun 03 09:14:11.933424 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 357/707] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:11 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:12.945188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b353b0e4-56fe-4fd5-9e94-9e37e27c3ee8 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b11a0430>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:12.981605 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b353b0e4-56fe-4fd5-9e94-9e37e27c3ee8 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 287 microversion: 2.1 time: 0.040630 Jun 03 09:14:12.982258 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 351/708] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:12 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:12.995591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3de96ebf-bbe9-4c35-b77c-7709468eb0e5 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b11f09d0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:13.054021 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3de96ebf-bbe9-4c35-b77c-7709468eb0e5 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 202 len: 0 microversion: 2.1 time: 0.063297 Jun 03 09:14:13.054945 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 358/709] 10.222.0.61 () {58 vars in 1253 bytes} [Fri Jun 3 09:14:12 2022] DELETE /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:14:13.062803 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3489c17b-6365-46df-a0a1-4b3bce8826b3 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b119d3a0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:13.092699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3489c17b-6365-46df-a0a1-4b3bce8826b3 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 200 len: 286 microversion: 2.1 time: 0.033659 Jun 03 09:14:13.093257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 352/710] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:13 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:14.104826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7acfcaec-e7bf-43f6-b90c-00f10ac3badf tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b13c40d0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:14.129877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-7acfcaec-e7bf-43f6-b90c-00f10ac3badf tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] HTTP exception thrown: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7acfcaec-e7bf-43f6-b90c-00f10ac3badf tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Request method failure captured: Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e HTTP/1.1 Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdDdrByCme4lxy5NxxfRqZKnyOeZ3TO3u7_ys6JFO5mMlbI0P1p7OGYZlkWsBwd_wSa3prw95eRomIfEkerGGI-fJpEGvcyXXLliVu3RNACTZtS4xu4I9mCLhMliQvhobcNkbyHXZ1NAx1_VDEr-WZF0qGdhXJS01aUDJUsH738wGgw Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:14:14.133102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 397341bd148a4fb0bf2ad9dc25ad6377 Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'b148fb8b-2478-45a4-b77e-396c41fac95e'} Jun 03 09:14:14.134679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. (HTTP 404) (Request-ID: req-9b50bc46-062f-4354-934f-3545d1717f07) Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.135683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:14.137106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 09:14:14.138524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7acfcaec-e7bf-43f6-b90c-00f10ac3badf tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Returning 404 to user: Snapshot b148fb8b-2478-45a4-b77e-396c41fac95e could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7acfcaec-e7bf-43f6-b90c-00f10ac3badf tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e" status: 404 len: 111 microversion: 2.1 time: 0.034554 Jun 03 09:14:14.139959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 359/711] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:14:14 2022] GET /compute/v2.1/os-snapshots/b148fb8b-2478-45a4-b77e-396c41fac95e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:14.143616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-75d31712-3d04-43a3-bf40-1db3c402c11e tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b122c160>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:14.202729 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-75d31712-3d04-43a3-bf40-1db3c402c11e tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 202 len: 0 microversion: 2.1 time: 0.063241 Jun 03 09:14:14.203275 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 353/712] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:14:14 2022] DELETE /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:14:14.211870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-37e8b312-6526-4d11-a5af-db5e378ebebc tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b124f430>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:14.261079 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-37e8b312-6526-4d11-a5af-db5e378ebebc tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 200 len: 345 microversion: 2.1 time: 0.053528 Jun 03 09:14:14.261642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 360/713] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:14 2022] GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:15.275299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc8c9777-9488-4edc-bbdf-d224b46c4c42 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b11a0670>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:15.303047 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-cc8c9777-9488-4edc-bbdf-d224b46c4c42 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] HTTP exception thrown: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc8c9777-9488-4edc-bbdf-d224b46c4c42 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Request method failure captured: Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 HTTP/1.1 Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdDdrByCme4lxy5NxxfRqZKnyOeZ3TO3u7_ys6JFO5mMlbI0P1p7OGYZlkWsBwd_wSa3prw95eRomIfEkerGGI-fJpEGvcyXXLliVu3RNACTZtS4xu4I9mCLhMliQvhobcNkbyHXZ1NAx1_VDEr-WZF0qGdhXJS01aUDJUsH738wGgw Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:15.305154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 397341bd148a4fb0bf2ad9dc25ad6377 Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'd850f115-e29f-487c-801f-4e1e09b3fa18'} Jun 03 09:14:15.306762 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. (HTTP 404) (Request-ID: req-7052d6ff-a5db-4aae-a989-a90f7b3b4b4a) Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.307675 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:15.308907 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:14:15.310058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cc8c9777-9488-4edc-bbdf-d224b46c4c42 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Returning 404 to user: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cc8c9777-9488-4edc-bbdf-d224b46c4c42 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 404 len: 109 microversion: 2.1 time: 0.036206 Jun 03 09:14:15.311317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 354/714] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:15 2022] GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:15.314642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:15.316227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:15.321437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c194a3db-d4ca-45ea-b9c1-c19891de09d6 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b124ff70>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:15.349498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-c194a3db-d4ca-45ea-b9c1-c19891de09d6 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] HTTP exception thrown: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c194a3db-d4ca-45ea-b9c1-c19891de09d6 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Request method failure captured: Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: DELETE /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 HTTP/1.1 Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdDdrByCme4lxy5NxxfRqZKnyOeZ3TO3u7_ys6JFO5mMlbI0P1p7OGYZlkWsBwd_wSa3prw95eRomIfEkerGGI-fJpEGvcyXXLliVu3RNACTZtS4xu4I9mCLhMliQvhobcNkbyHXZ1NAx1_VDEr-WZF0qGdhXJS01aUDJUsH738wGgw Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:14:15.351803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 397341bd148a4fb0bf2ad9dc25ad6377 Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'd850f115-e29f-487c-801f-4e1e09b3fa18'} Jun 03 09:14:15.353437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. (HTTP 404) (Request-ID: req-ea108356-c742-4de8-89b1-5907b2cec005) Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.356487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:15.357939 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:14:15.359319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c194a3db-d4ca-45ea-b9c1-c19891de09d6 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Returning 404 to user: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c194a3db-d4ca-45ea-b9c1-c19891de09d6 tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 404 len: 109 microversion: 2.1 time: 0.039716 Jun 03 09:14:15.361227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 361/715] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:14:15 2022] DELETE /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:15.362665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:15.363285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2aaeadfc-0add-4fb3-b059-3595f5aa55fb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Calling method '.version_select at 0x7fd2b1249310>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:15.389689 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-2aaeadfc-0add-4fb3-b059-3595f5aa55fb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] HTTP exception thrown: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2aaeadfc-0add-4fb3-b059-3595f5aa55fb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Request method failure captured: Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 HTTP/1.1 Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdDdrByCme4lxy5NxxfRqZKnyOeZ3TO3u7_ys6JFO5mMlbI0P1p7OGYZlkWsBwd_wSa3prw95eRomIfEkerGGI-fJpEGvcyXXLliVu3RNACTZtS4xu4I9mCLhMliQvhobcNkbyHXZ1NAx1_VDEr-WZF0qGdhXJS01aUDJUsH738wGgw Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:15.391615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fad3d9f6ce7b4b328a2c8749650312af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: fad3d9f6ce7b4b328a2c8749650312af Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-705748807 Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 397341bd148a4fb0bf2ad9dc25ad6377 Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-705748807-project Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'd850f115-e29f-487c-801f-4e1e09b3fa18'} Jun 03 09:14:15.393183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. (HTTP 404) (Request-ID: req-2be6bfb4-b3c2-4877-a2d1-e213653a12fb) Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.394247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:15.395582 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:14:15.397346 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2aaeadfc-0add-4fb3-b059-3595f5aa55fb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] Returning 404 to user: Volume d850f115-e29f-487c-801f-4e1e09b3fa18 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2aaeadfc-0add-4fb3-b059-3595f5aa55fb tempest-VolumesSnapshotsTestJSON-705748807 tempest-VolumesSnapshotsTestJSON-705748807-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18" status: 404 len: 109 microversion: 2.1 time: 0.035183 Jun 03 09:14:15.399224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 355/716] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:15 2022] GET /compute/v2.1/os-volumes/d850f115-e29f-487c-801f-4e1e09b3fa18 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:16.766752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a2d68a2b-9395-4cd1-a795-b725a388bfbb tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Action: 'create', calling method: .version_select at 0x7fd2b140bdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-817310164", "metadata": {"Type": "work"}}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a2d68a2b-9395-4cd1-a795-b725a388bfbb tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 121 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:14:16.775361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-817310164", "metadata": {"Type": "work"}}} Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: Jun 03 09:14:16.776999 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-817310164', 'metadata': {'Type': 'work'}}}} Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.777952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:14:16.779587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:14:16.781011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:14:16.781011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.781011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a2d68a2b-9395-4cd1-a795-b725a388bfbb tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.781011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a2d68a2b-9395-4cd1-a795-b725a388bfbb tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122246 Jun 03 09:14:16.781011 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 362/717] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 09:14:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:14:16.783233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:16.788603 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b6579c2-ce1e-4c55-8031-13caac136cc4 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Action: 'create', calling method: .version_select at 0x7fd2b1249040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1390165340", "metadata": {"Type": "work"}}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b6579c2-ce1e-4c55-8031-13caac136cc4 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 120 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:16.792168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1390165340", "metadata": {"Type": "work"}}} Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:14:16.793702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1390165340', 'metadata': {'Type': 'work'}}}} Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi '0' Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.794655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:14:16.796358 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:14:16.797683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:14:16.797683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.797683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b6579c2-ce1e-4c55-8031-13caac136cc4 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.797683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1b6579c2-ce1e-4c55-8031-13caac136cc4 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011029 Jun 03 09:14:16.797683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 356/718] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 09:14:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:14:16.803675 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c14656e1-2fce-4a06-a989-0b90a3b5cb1e tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Action: 'create', calling method: .version_select at 0x7fd2b140b4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1694525926", "metadata": {"Type": "work"}}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c14656e1-2fce-4a06-a989-0b90a3b5cb1e tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 119 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:14:16.806028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1694525926", "metadata": {"Type": "work"}}} Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: Jun 03 09:14:16.807556 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1694525926', 'metadata': {'Type': 'work'}}}} Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi '' Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.808529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:14:16.810099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:14:16.811436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:14:16.811436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.811436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c14656e1-2fce-4a06-a989-0b90a3b5cb1e tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.811436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c14656e1-2fce-4a06-a989-0b90a3b5cb1e tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008421 Jun 03 09:14:16.811436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 363/719] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jun 3 09:14:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:14:16.817148 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-303a4a4e-f55d-49f0-b099-d4481fd9b539 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Calling method '.version_select at 0x7fd2b122caf0>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:16.846219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-303a4a4e-f55d-49f0-b099-d4481fd9b539 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] HTTP exception thrown: Volume tempest-invalid-1375434153 could not be found. Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-303a4a4e-f55d-49f0-b099-d4481fd9b539 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1375434153 HTTP/1.1 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:16.848188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Volume tempest-invalid-1375434153 could not be found. Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'tempest-invalid-1375434153'} Jun 03 09:14:16.849714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1375434153 could not be found. (HTTP 404) (Request-ID: req-3ea2b649-8587-4300-a36a-d8cba276ce89) Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.850684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:16.852032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1375434153 could not be found. Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:16.853333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1375434153 could not be found. Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1375434153 could not be found. Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-303a4a4e-f55d-49f0-b099-d4481fd9b539 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 404 to user: Volume tempest-invalid-1375434153 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-303a4a4e-f55d-49f0-b099-d4481fd9b539 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1375434153" status: 404 len: 99 microversion: 2.1 time: 0.036890 Jun 03 09:14:16.854680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 357/720] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 09:14:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1375434153 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 09:14:16.858991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a5a15b99-f592-40e2-b4b1-f0e5f1f3241c tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003774 Jun 03 09:14:16.859472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 364/721] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jun 3 09:14:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 03 09:14:16.867406 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5255514b-2a7e-4131-a061-97d3870bb677 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003603 Jun 03 09:14:16.867903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 358/722] 10.222.0.61 () {58 vars in 1136 bytes} [Fri Jun 3 09:14:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 09:14:16.875691 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e34a0816-848a-48a5-89e1-118364dc5cb7 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Calling method '.version_select at 0x7fd2b16bec10>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:16.907030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-e34a0816-848a-48a5-89e1-118364dc5cb7 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] HTTP exception thrown: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e34a0816-848a-48a5-89e1-118364dc5cb7 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: DELETE /compute/v2.1/os-volumes/521842df-7169-4612-83fa-f4a3b64f4adc HTTP/1.1 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:14:16.909308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '521842df-7169-4612-83fa-f4a3b64f4adc'} Jun 03 09:14:16.910869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. (HTTP 404) (Request-ID: req-7eec1bab-3082-4908-a9a2-e1b4ecd9b7ec) Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.911807 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:14:16.913292 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:14:16.914777 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e34a0816-848a-48a5-89e1-118364dc5cb7 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 404 to user: Volume 521842df-7169-4612-83fa-f4a3b64f4adc could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e34a0816-848a-48a5-89e1-118364dc5cb7 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/521842df-7169-4612-83fa-f4a3b64f4adc" status: 404 len: 109 microversion: 2.1 time: 0.038495 Jun 03 09:14:16.916487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 365/723] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:14:16 2022] DELETE /compute/v2.1/os-volumes/521842df-7169-4612-83fa-f4a3b64f4adc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 09:14:16.920229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fbd90e3-9347-4162-ae81-c5d6b3b858c0 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Calling method '.version_select at 0x7fd2b11a0c10>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:16.946866 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-4fbd90e3-9347-4162-ae81-c5d6b3b858c0 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] HTTP exception thrown: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fbd90e3-9347-4162-ae81-c5d6b3b858c0 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Request method failure captured: Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/os-volumes/dda211a9-42de-4821-b619-db6d12221aa6 HTTP/1.1 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdDoeD3-xCQfkYVVLA2GVr4mNJQVyelAzd7gYQ1M-ecWSoFgMsgRMM9y-X56KMX-TStciE-2u59-E-5fIdn1klKLXtg9mzAkQmauU4uUwJAchqhH0CsmpDJRo4eQtZ1Xmw1fO6ultcTWEIq3i2at3SzdRfjK6Hvh7DP6PiLe8nRrkj0 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:16.948816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8b045274bbe84d77a312203e2e48f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8b045274bbe84d77a312203e2e48f415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 8b045274bbe84d77a312203e2e48f415 Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesNegativeTest-443097233 Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 89486ab76a16423bacae2bd0564ef7f6 Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesNegativeTest-443097233-project Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'dda211a9-42de-4821-b619-db6d12221aa6'} Jun 03 09:14:16.950310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. (HTTP 404) (Request-ID: req-53e31949-ac29-46d6-864c-6541e264b69e) Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.951316 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:14:16.952745 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:14:16.953932 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fbd90e3-9347-4162-ae81-c5d6b3b858c0 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] Returning 404 to user: Volume dda211a9-42de-4821-b619-db6d12221aa6 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4fbd90e3-9347-4162-ae81-c5d6b3b858c0 tempest-VolumesNegativeTest-443097233 tempest-VolumesNegativeTest-443097233-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/dda211a9-42de-4821-b619-db6d12221aa6" status: 404 len: 109 microversion: 2.1 time: 0.033776 Jun 03 09:14:16.955143 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 359/724] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jun 3 09:14:16 2022] GET /compute/v2.1/os-volumes/dda211a9-42de-4821-b619-db6d12221aa6 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:32.271678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:32.272255 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:32.278857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:32.279300 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:32.280126 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:32.280558 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:32.366517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lazy-loading 'services' on Instance uuid de0ed531-4475-4b81-a823-2de95394c347 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:14:32.439915 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-82d58254-052e-4540-aa09-c2baa2c70bb9 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "DELETE /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347/os-volume_attachments/02075a98-2115-491c-b76b-ecb1197f4a98" status: 202 len: 0 microversion: 2.1 time: 0.173325 Jun 03 09:14:32.440960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 366/725] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:14:32 2022] DELETE /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347/os-volume_attachments/02075a98-2115-491c-b76b-ecb1197f4a98 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:14:33.556655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:33.557257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:33.563540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:33.564012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:33.564763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:33.565188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:33.589129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:14:33.667156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fb44a242-c357-4d98-9dbb-60a619a116b8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "DELETE /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 204 len: 0 microversion: 2.1 time: 0.115314 Jun 03 09:14:33.668004 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 360/726] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:14:33 2022] DELETE /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:14:33.678935 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:33.679902 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:33.686282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:33.686751 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:33.687517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:33.688016 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:33.819227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:33.826830 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-09083bfe-453d-4a42-85f7-d6cf08200be3 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1512 microversion: 2.1 time: 0.154323 Jun 03 09:14:33.827399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 367/727] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:33 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:34.846032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:34.846753 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:34.854082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:34.854534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:34.855307 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:34.855738 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:34.999787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:35.009393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-23e151b9-fc89-4a2e-82ba-5f55583ee0f8 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1512 microversion: 2.1 time: 0.167520 Jun 03 09:14:35.010227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 361/728] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:34 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:14:36.026681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:36.027350 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:36.034149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:36.034598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:36.035356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:36.035813 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:36.168915 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:36.176467 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c4db5886-1f01-4342-a552-f254cf72310f tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1512 microversion: 2.1 time: 0.153763 Jun 03 09:14:36.177020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 368/729] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:36 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:37.193968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:37.194586 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:37.201705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:37.202155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:37.202916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:37.203351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:37.330430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:37.338500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a317e4a-6077-494a-b5fb-5728e0b81013 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1512 microversion: 2.1 time: 0.148504 Jun 03 09:14:37.339065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 362/730] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:37 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:38.360403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:38.361537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:38.371957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:38.372863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:38.373990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:38.374528 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:38.538307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:38.547118 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-18cdab1c-1026-46db-9db8-cf29a25a9e15 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1512 microversion: 2.1 time: 0.193633 Jun 03 09:14:38.547821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 369/731] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:38 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:14:39.315820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-26e41346-08df-4dea-923b-141a273f72d3 req-b35d28b9-0843-42c5-bd28-010883236241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0ed531-4475-4b81-a823-2de95394c347", "name": "network-vif-deleted", "tag": "23a989f6-4f8b-47ee-b9cc-9590b1ae1440"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:39.327446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-26e41346-08df-4dea-923b-141a273f72d3 req-b35d28b9-0843-42c5-bd28-010883236241 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:39.327991 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-26e41346-08df-4dea-923b-141a273f72d3 req-b35d28b9-0843-42c5-bd28-010883236241 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:39.339419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-26e41346-08df-4dea-923b-141a273f72d3 req-b35d28b9-0843-42c5-bd28-010883236241 service nova] Creating event network-vif-deleted:23a989f6-4f8b-47ee-b9cc-9590b1ae1440 for instance de0ed531-4475-4b81-a823-2de95394c347 on hv-cinder-81268 Jun 03 09:14:39.345125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-26e41346-08df-4dea-923b-141a273f72d3 req-b35d28b9-0843-42c5-bd28-010883236241 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 Jun 03 09:14:39.345712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 363/732] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:39.565617 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:39.566337 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:39.573612 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:39.574171 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:39.575065 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:39.575738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:39.610519 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:39.610966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:39.611417 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lazy-loading 'fault' on Instance uuid de0ed531-4475-4b81-a823-2de95394c347 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:14:39.657942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '544a8ed11787431db393494eefcba2e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b6a4abd9342caa18f150846d0277d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:39.666970 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bea2c760-a6d6-46c0-bbdf-418be554b9bb tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 200 len: 1308 microversion: 2.1 time: 0.105816 Jun 03 09:14:39.667539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 370/733] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:39 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:40.684803 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:40.685798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] [instance: de0ed531-4475-4b81-a823-2de95394c347] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:40.692755 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:40.693257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:40.694071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:40.694507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:40.708695 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] HTTP exception thrown: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Request method failure captured: Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 HTTP/1.1 Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdBw5n2IDAykkZed2-SQZHgyiSiRVCd60qYLXrf8O79aMcgh3po4jhtleguD8v6aX4ywntut35hGVmlTLoguSpjqGYmWmJRnuIqG_JK8GMpd894rWDOWhrYp2O6I7JFYmRWGl9snAv0hJQBbCCpA9GAS1E-h-vsd8Yocf2PB7NX8Sag Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 550b6a4abd9342caa18f150846d0277d Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:14:40.710420 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_550b6a4abd9342caa18f150846d0277d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/550b6a4abd9342caa18f150846d0277d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 550b6a4abd9342caa18f150846d0277d Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1495270933 Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-VolumesSnapshotTestJSON-1495270933-project Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 544a8ed11787431db393494eefcba2e6 Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-VolumesSnapshotTestJSON-1495270933-project Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. Jun 03 09:14:40.712631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'de0ed531-4475-4b81-a823-2de95394c347'} Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:14:40.713413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. Jun 03 09:14:40.717380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:14:40.719158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] Returning 404 to user: Instance de0ed531-4475-4b81-a823-2de95394c347 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:14:40.719158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d1235ba7-e6aa-475c-9bad-e36db2ffb462 tempest-VolumesSnapshotTestJSON-1495270933 tempest-VolumesSnapshotTestJSON-1495270933-project] 10.222.0.61 "GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347" status: 404 len: 111 microversion: 2.1 time: 0.032925 Jun 03 09:14:40.719158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 364/734] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:40 2022] GET /compute/v2.1/servers/de0ed531-4475-4b81-a823-2de95394c347 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:14:42.904193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1716731228", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-615997502", "security_groups": [{"name": "tempest-secgroup-smoke-2001127604"}], "block_device_mapping_v2": [{"uuid": "a546b70d-1794-44e7-a145-513c839f08d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db505cc9-4748-4bbb-a7a3-c41105ee8dab"}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:43.174496 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] validate_networks() for [('db505cc9-4748-4bbb-a7a3-c41105ee8dab', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:14:43.606661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:14:43.607074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:14:43.607539 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:14:43.607987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:14:43.608393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:14:43.617301 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:43.617678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:43.618462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:43.618889 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:43.635660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:14:43.639715 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Getting quotas for user acbec87f607d4e00a2107c572fc68643 and project c506ed29f8d94060bb8685604e8f3798. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:14:43.701550 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:14:43.703794 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a546b70d-1794-44e7-a145-513c839f08d0',volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:14:43.832450 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c8baeda1-30da-412b-b21a-ce5a7f46f5fe tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.931885 Jun 03 09:14:43.839317 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 371/735] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:14:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:14:43.844657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cd1f048a-9b06-4b48-886a-67dbc053478e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:43.845394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cd1f048a-9b06-4b48-886a-67dbc053478e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:44.010084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cd1f048a-9b06-4b48-886a-67dbc053478e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:44.016788 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cd1f048a-9b06-4b48-886a-67dbc053478e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1094 microversion: 2.1 time: 0.176221 Jun 03 09:14:44.017349 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 365/736] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:43 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1094 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:45.035027 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:45.035633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:45.043083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:45.043524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:45.044321 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:45.044760 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:45.114228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:45.121792 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e4e1a97d-2aea-4ed0-a403-f42d0ec890b3 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1144 microversion: 2.1 time: 0.091338 Jun 03 09:14:45.122557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 372/737] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:45 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:46.138456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:46.139071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:46.148313 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:46.148773 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:46.150222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:46.150669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:46.214648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:46.222075 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19ff9999-3236-45e3-8349-acb7f665dd28 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1144 microversion: 2.1 time: 0.088174 Jun 03 09:14:46.222652 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 366/738] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:46 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:47.238450 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:47.238965 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:47.245529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:47.245976 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:47.246768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:47.247199 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:47.307208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:47.315034 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0ddd45d1-9047-4bc2-baae-10dae4e8c366 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1144 microversion: 2.1 time: 0.080503 Jun 03 09:14:47.315610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 373/739] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:47 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:48.332875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:48.333493 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:48.340383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:48.340834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:48.341594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:48.342030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:48.404014 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:48.411917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df1ea7a9-57e2-45aa-8391-dbb86e0dcc48 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1210 microversion: 2.1 time: 0.084602 Jun 03 09:14:48.412661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 367/740] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:48 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:49.432208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:49.432721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:49.439524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:49.440218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:49.441353 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:49.442006 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:49.618535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:49.627381 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4e764f84-b236-442a-8d1f-90e3f4337761 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.202282 Jun 03 09:14:49.642179 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 374/741] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:49 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:49.861873 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-04d5ceaf-1a7e-4bd2-8b44-1d4112868756 req-ded91b58-61b4-417f-8ab4-c50ce3d0390d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7540ba8e-17a4-46e9-89c4-cae8137deb70", "tag": "70e90032-900d-4182-bf8a-bcaa28245d3a"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:14:49.905298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-04d5ceaf-1a7e-4bd2-8b44-1d4112868756 req-ded91b58-61b4-417f-8ab4-c50ce3d0390d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:49.905725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-04d5ceaf-1a7e-4bd2-8b44-1d4112868756 req-ded91b58-61b4-417f-8ab4-c50ce3d0390d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:49.964479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-04d5ceaf-1a7e-4bd2-8b44-1d4112868756 req-ded91b58-61b4-417f-8ab4-c50ce3d0390d service nova] Creating event network-changed:70e90032-900d-4182-bf8a-bcaa28245d3a for instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 on hv-cinder-81268 Jun 03 09:14:49.971182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-04d5ceaf-1a7e-4bd2-8b44-1d4112868756 req-ded91b58-61b4-417f-8ab4-c50ce3d0390d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113784 Jun 03 09:14:49.972268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 368/742] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:14:50.645850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:50.646464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:50.652947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:50.653399 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:50.654253 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:50.654590 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:50.790626 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:50.798142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1be7773b-50da-4e41-8401-04711e5451fb tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.156176 Jun 03 09:14:50.798730 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 375/743] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:50 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:51.815221 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:51.815958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:51.824697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:51.825160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:51.826124 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:51.826560 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:52.016915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:52.025224 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f4e1dba-97c2-49ec-a0b7-743eff7ce9a6 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.214189 Jun 03 09:14:52.026510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 369/744] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:51 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:53.042964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:53.043587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:53.050260 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:53.050715 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:53.051485 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:53.051966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:53.186077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:53.193670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3a70b586-b3ec-41c9-a677-a7815372709c tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.155048 Jun 03 09:14:53.194608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 376/745] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:53 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:54.210057 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:54.210679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:54.213838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:54.219589 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:54.223079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:54.223079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:54.223079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:54.376282 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:54.383992 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1ec1a122-a77f-4569-bb1c-ac3ec8a81af1 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.177910 Jun 03 09:14:54.385472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 370/746] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:54 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:55.401996 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:55.402601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:55.404572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:55.405235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:55.411624 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:55.412113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:55.412885 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:55.413326 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:55.548046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:55.555544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cef017e1-ff89-426b-a929-fcfdd02a8f36 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.157933 Jun 03 09:14:55.556220 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 377/747] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:55 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:56.572405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:56.573011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:56.579235 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:56.579687 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:56.580487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:56.580926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:56.708036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:56.715701 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2eabe7be-189c-4cd5-8931-6f50fcc21948 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.147316 Jun 03 09:14:56.716301 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 371/748] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:56 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:57.733748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:57.734360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:57.740870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:57.741314 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:57.742074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:57.742507 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:57.878391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:57.886446 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ee664dbc-8a97-492a-9f84-3390b25b55f7 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.156859 Jun 03 09:14:57.887008 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 378/749] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:57 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:14:58.903719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:14:58.904438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:14:58.911333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:58.911812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:58.912594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:14:58.913066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:14:59.057170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:14:59.060002 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d6704a30-18a3-4f74-b40e-3368bf6b59dd tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.160969 Jun 03 09:14:59.060565 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 372/750] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:14:58 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:00.077051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:00.077656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:00.083617 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:00.084085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:00.084838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:00.085271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:00.242085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:00.251172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3157602c-6a0a-4646-85ba-afecfdd7cd69 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.178020 Jun 03 09:15:00.251805 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 379/751] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:00 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:01.267644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:01.268342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:01.275095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:01.276139 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:01.276911 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:01.277337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:01.408717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:01.416380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-88ffd9d7-8b82-4f31-b1dc-29c73a792d4e tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.152563 Jun 03 09:15:01.416955 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 373/752] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:01 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:02.433228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:02.433931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:02.436452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:02.441776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:02.442223 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:02.442983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:02.443426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:02.447146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:02.587563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:02.595922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-de5702d4-d29e-4b1c-a568-36acd844750b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.166722 Jun 03 09:15:02.596483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 380/753] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:02 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:03.222255 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-9fbd5bc4-945a-4377-b974-8a06a6b48559 req-59db2765-399a-4c8a-80ba-4f016f270dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7540ba8e-17a4-46e9-89c4-cae8137deb70", "name": "network-vif-plugged", "status": "completed", "tag": "70e90032-900d-4182-bf8a-bcaa28245d3a"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:03.231467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9fbd5bc4-945a-4377-b974-8a06a6b48559 req-59db2765-399a-4c8a-80ba-4f016f270dbb service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:03.231953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9fbd5bc4-945a-4377-b974-8a06a6b48559 req-59db2765-399a-4c8a-80ba-4f016f270dbb service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:03.243909 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-9fbd5bc4-945a-4377-b974-8a06a6b48559 req-59db2765-399a-4c8a-80ba-4f016f270dbb service nova] Creating event network-vif-plugged:70e90032-900d-4182-bf8a-bcaa28245d3a for instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 on hv-cinder-81268 Jun 03 09:15:03.249590 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-9fbd5bc4-945a-4377-b974-8a06a6b48559 req-59db2765-399a-4c8a-80ba-4f016f270dbb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 Jun 03 09:15:03.250402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 374/754] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:03.618255 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:03.618894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:03.627729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:03.628210 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:03.628993 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:03.629419 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:03.782460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:03.790122 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-da6a2d9b-3b2b-43d4-8011-607111eea10a tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.175735 Jun 03 09:15:03.790678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 381/755] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:03 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:04.807503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:04.809792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:04.813057 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:04.817076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:04.817656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:04.818521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:04.819059 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:04.822903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:04.968167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:04.976474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba88bc5d-70b1-4407-9cfc-7d90e4ff2d74 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1266 microversion: 2.1 time: 0.173385 Jun 03 09:15:04.977065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 375/756] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:04 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:05.999023 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:05.999649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:06.006479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:06.006929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:06.008055 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:06.009462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:06.194801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:06.203249 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7f8eccfc-f065-43ba-97d1-45ea43bcb49b tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1453 microversion: 2.1 time: 0.213748 Jun 03 09:15:06.215336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 382/757] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:05 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:06.224046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:06.225108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:06.240524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:06.241281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:06.242735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:06.243454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:06.395705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:06.404034 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d43f3a7b-44a1-49f4-9e88-80f04cfd73f4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1453 microversion: 2.1 time: 0.187009 Jun 03 09:15:06.404610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 376/758] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:06 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:08.361228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-c2cf18e0-c71b-4161-a2f2-a1ba62fc91e1 req-d7aea13c-ef69-4c66-bde0-6dcaa88869de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7540ba8e-17a4-46e9-89c4-cae8137deb70", "tag": "70e90032-900d-4182-bf8a-bcaa28245d3a"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:08.370557 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-c2cf18e0-c71b-4161-a2f2-a1ba62fc91e1 req-d7aea13c-ef69-4c66-bde0-6dcaa88869de service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:08.371038 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-c2cf18e0-c71b-4161-a2f2-a1ba62fc91e1 req-d7aea13c-ef69-4c66-bde0-6dcaa88869de service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:08.382695 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-c2cf18e0-c71b-4161-a2f2-a1ba62fc91e1 req-d7aea13c-ef69-4c66-bde0-6dcaa88869de service nova] Creating event network-changed:70e90032-900d-4182-bf8a-bcaa28245d3a for instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 on hv-cinder-81268 Jun 03 09:15:08.388465 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-c2cf18e0-c71b-4161-a2f2-a1ba62fc91e1 req-d7aea13c-ef69-4c66-bde0-6dcaa88869de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Jun 03 09:15:08.389160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 383/759] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:15:09.978080 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-677022723", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "networks": [{"uuid": "f9174054-005d-4d0c-acae-ca5598c8c5b3"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:10.035594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] validate_networks() for [('f9174054-005d-4d0c-acae-ca5598c8c5b3', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:15:10.397877 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:15:10.398375 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:15:10.398920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:15:10.399402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:15:10.399949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:15:10.410115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:10.410649 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:10.411526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:10.412069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:10.431928 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Getting quotas for project 631f795e5b9d4d5c827da91bc1a94882. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:15:10.436656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Getting quotas for user ad2fc05d9f18490c96c92f123f40a261 and project 631f795e5b9d4d5c827da91bc1a94882. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:15:10.447653 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:15:10.450794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:15:10.501882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d59e066-8286-4ea0-ac58-96781257b13e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527504 Jun 03 09:15:10.503041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 377/760] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:15:10.514615 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7111eaac-19b2-4fdc-b110-f25eb9fb415c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:10.515430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7111eaac-19b2-4fdc-b110-f25eb9fb415c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:10.577911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7111eaac-19b2-4fdc-b110-f25eb9fb415c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:10.585894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7111eaac-19b2-4fdc-b110-f25eb9fb415c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1213 microversion: 2.1 time: 0.077028 Jun 03 09:15:10.587069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 384/761] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:10 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:11.603697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:11.604340 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:11.617474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:11.618185 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:11.619897 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:11.622036 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:11.959960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:11.969281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-aa1f1705-bd9b-4388-b1e2-b9b09c192b36 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1283 microversion: 2.1 time: 0.370078 Jun 03 09:15:11.970116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 378/762] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:11 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1283 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:12.996608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:12.997406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:13.006703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:13.007511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:13.008620 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:13.009279 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:13.218698 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-c3023acc-b06d-4b86-a997-68ac88b2af98 req-af07a3f5-3835-49d8-9108-0ca23c62a190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f9208d-09ec-42d8-9062-849568c6a234", "tag": "f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:13.230145 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c3023acc-b06d-4b86-a997-68ac88b2af98 req-af07a3f5-3835-49d8-9108-0ca23c62a190 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:13.230894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c3023acc-b06d-4b86-a997-68ac88b2af98 req-af07a3f5-3835-49d8-9108-0ca23c62a190 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:13.248887 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-c3023acc-b06d-4b86-a997-68ac88b2af98 req-af07a3f5-3835-49d8-9108-0ca23c62a190 service nova] Creating event network-changed:f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef for instance 91f9208d-09ec-42d8-9062-849568c6a234 on hv-cinder-81268 Jun 03 09:15:13.255856 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-c3023acc-b06d-4b86-a997-68ac88b2af98 req-af07a3f5-3835-49d8-9108-0ca23c62a190 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043392 Jun 03 09:15:13.257188 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 379/763] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:13.266471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:13.275140 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ca3e82bd-b5d5-4e25-8b42-0917722b4203 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.292205 Jun 03 09:15:13.275738 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 385/764] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:12 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:14.295236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:14.299934 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:14.309254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:14.309835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:14.310717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:14.311727 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:14.501342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:14.512413 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9a0afb6a-c7b1-4af2-b3bc-780a4266731b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.221877 Jun 03 09:15:14.513897 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 380/765] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:14 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:15.531332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:15.532843 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:15.541526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:15.542313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:15.543273 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:15.543997 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:15.703776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:15.713520 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7cfbe66b-60c1-405b-b58a-77d78e223be4 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.186998 Jun 03 09:15:15.714254 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 386/766] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:15 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:16.732365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:16.733061 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:16.752954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:16.753705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:16.754736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:16.755424 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:16.928567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:16.941542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-af079678-7e95-481b-b9dc-66e2e9ba8889 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.213903 Jun 03 09:15:16.953315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 381/767] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:16 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:17.961360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:17.962086 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:17.975560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:17.976926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:17.978013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:17.978547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:18.181211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:18.190205 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5aeffdef-ac6b-4328-b988-ed2d032d3448 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.232946 Jun 03 09:15:18.192430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 387/768] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:17 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:19.219988 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:19.220615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:19.230191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:19.230886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:19.231736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:19.233477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:19.404092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:19.413254 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9858351-697f-4459-a5c3-451d82bb0afe tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.197145 Jun 03 09:15:19.424112 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 382/769] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:19 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:20.430909 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:20.432163 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:20.441869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:20.442662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:20.443563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:20.444044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:20.582774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:20.597686 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:20.605706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1372f1bf-7676-4917-b084-b60547a958aa tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.178600 Jun 03 09:15:20.606560 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 388/770] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:20 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:21.622631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:21.624124 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:21.629686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:21.635081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:21.640768 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:21.641458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:21.642498 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:21.643089 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:21.721037 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-53c09822-fdc3-4111-be27-d0d209a9db3b req-c2d87d07-a3ed-452b-bcc3-683beb624446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f9208d-09ec-42d8-9062-849568c6a234", "name": "network-vif-plugged", "status": "completed", "tag": "f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:21.735356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-53c09822-fdc3-4111-be27-d0d209a9db3b req-c2d87d07-a3ed-452b-bcc3-683beb624446 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:21.735356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-53c09822-fdc3-4111-be27-d0d209a9db3b req-c2d87d07-a3ed-452b-bcc3-683beb624446 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:21.777300 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-53c09822-fdc3-4111-be27-d0d209a9db3b req-c2d87d07-a3ed-452b-bcc3-683beb624446 service nova] Creating event network-vif-plugged:f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef for instance 91f9208d-09ec-42d8-9062-849568c6a234 on hv-cinder-81268 Jun 03 09:15:21.784513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-53c09822-fdc3-4111-be27-d0d209a9db3b req-c2d87d07-a3ed-452b-bcc3-683beb624446 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067400 Jun 03 09:15:21.785384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 389/771] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:15:21.895393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:21.906053 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fad294a8-946e-443f-8973-251e34c69756 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.286172 Jun 03 09:15:21.907330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 383/772] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:21 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:22.928031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:22.928733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:22.948804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:22.949570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:22.950984 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:22.951587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:23.134898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:23.143821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-408696f8-068b-4000-82e0-5d6bfb39e914 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1313 microversion: 2.1 time: 0.219848 Jun 03 09:15:23.144647 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 390/773] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:22 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:24.162622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:24.163921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:24.173574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:24.174759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:24.176210 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:24.177287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:24.366213 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:24.375692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-21f0798a-3f85-4e1c-b2d5-ef1d4a164b8c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1496 microversion: 2.1 time: 0.218095 Jun 03 09:15:24.376451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 384/774] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:24 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1496 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:24.969107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:24.970509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:24.990136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:24.990942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:24.992010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:24.992459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:25.026108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:15:25.167278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-49cec39f-74dd-45ee-8d18-0a784c3e842c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "DELETE /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 204 len: 0 microversion: 2.1 time: 0.207196 Jun 03 09:15:25.168697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 391/775] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:15:24 2022] DELETE /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:15:25.177232 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:25.178564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:25.186126 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:25.186952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:25.187963 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:25.188601 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:25.657811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:25.673450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-31aefbd3-184b-4438-8260-fb0d6752821f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1502 microversion: 2.1 time: 0.500364 Jun 03 09:15:25.674416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 385/776] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:25 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1502 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:26.691796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:26.692607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:26.702035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:26.702690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:26.703657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:26.704206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:26.969160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:26.979865 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-43c651b9-f70f-41f2-a26b-1df2f605a1df tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 200 len: 1502 microversion: 2.1 time: 0.292863 Jun 03 09:15:26.993820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 392/777] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:26 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:27.355370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-a3f89651-5551-4b05-ab65-cef4017d32a5 req-e9d0fbbc-3d6c-46b6-a933-65ce8bdfeb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f9208d-09ec-42d8-9062-849568c6a234", "name": "network-vif-deleted", "tag": "f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:27.370870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a3f89651-5551-4b05-ab65-cef4017d32a5 req-e9d0fbbc-3d6c-46b6-a933-65ce8bdfeb87 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:27.371239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a3f89651-5551-4b05-ab65-cef4017d32a5 req-e9d0fbbc-3d6c-46b6-a933-65ce8bdfeb87 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:27.383484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-a3f89651-5551-4b05-ab65-cef4017d32a5 req-e9d0fbbc-3d6c-46b6-a933-65ce8bdfeb87 service nova] Creating event network-vif-deleted:f14cd842-a5a3-45b9-8eca-ef09ccdaa3ef for instance 91f9208d-09ec-42d8-9062-849568c6a234 on hv-cinder-81268 Jun 03 09:15:27.388976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-a3f89651-5551-4b05-ab65-cef4017d32a5 req-e9d0fbbc-3d6c-46b6-a933-65ce8bdfeb87 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037836 Jun 03 09:15:27.389858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 386/778] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:15:27.997193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:28.000660 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 91f9208d-09ec-42d8-9062-849568c6a234] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:28.007732 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:28.008228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:28.008988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:28.009414 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:28.024653 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] HTTP exception thrown: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Request method failure captured: Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 HTTP/1.1 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdEcBUs9av2UGMHusyGDGC71hFsJ_O1-uSkONbXlNhwcnRgpeT9zioEwnlY7cS5pkhLGx4WRSrXb5CFuIT9HM4jTxx2nNjdT4SlkB6__z4__Sbm803W-lR8MLrK8hVnEGjoPWDvBohKXauFAh_xnK7GCIC2DZEr3m3Rnwh7GW3a37nU Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 631f795e5b9d4d5c827da91bc1a94882 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesActionsTest-2094814147 Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:15:28.027315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesActionsTest-2094814147 Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 631f795e5b9d4d5c827da91bc1a94882 Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesActionsTest-2094814147 Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesActionsTest-2094814147-project Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: ad2fc05d9f18490c96c92f123f40a261 Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesActionsTest-2094814147-project Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. Jun 03 09:15:28.028703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '91f9208d-09ec-42d8-9062-849568c6a234'} Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:28.029484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. Jun 03 09:15:28.030783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:28.033524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Returning 404 to user: Instance 91f9208d-09ec-42d8-9062-849568c6a234 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:28.034374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b60a2aac-f6b9-4e73-8fe6-b1a081176b40 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234" status: 404 len: 111 microversion: 2.1 time: 0.041305 Jun 03 09:15:28.034923 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 393/779] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:27 2022] GET /compute/v2.1/servers/91f9208d-09ec-42d8-9062-849568c6a234 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:15:28.145351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1836035851", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "networks": [{"uuid": "f9174054-005d-4d0c-acae-ca5598c8c5b3"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:28.197554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] validate_networks() for [('f9174054-005d-4d0c-acae-ca5598c8c5b3', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:15:28.612271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:15:28.613553 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:15:28.614219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:15:28.614824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:15:28.615240 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:15:28.625791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:28.628532 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:28.629576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:28.630204 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:28.651930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Getting quotas for project 631f795e5b9d4d5c827da91bc1a94882. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:15:28.656551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Getting quotas for user ad2fc05d9f18490c96c92f123f40a261 and project 631f795e5b9d4d5c827da91bc1a94882. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:15:28.680167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:15:28.683514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:15:28.748115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4ab35d8e-95df-4b8f-b24a-af5471915732 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606970 Jun 03 09:15:28.749027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 387/780] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:15:28.759781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c0893a4a-0070-4752-8fa3-0c1e76af597d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:28.760395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c0893a4a-0070-4752-8fa3-0c1e76af597d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:28.832151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c0893a4a-0070-4752-8fa3-0c1e76af597d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:28.845714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c0893a4a-0070-4752-8fa3-0c1e76af597d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1214 microversion: 2.1 time: 0.090398 Jun 03 09:15:28.846541 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 394/781] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:28 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:29.867440 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:29.868281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:29.875548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:29.876031 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:29.876801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:29.877230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:29.961720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:29.972915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-045a920a-9ead-4acb-803b-068a11cb7c81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1274 microversion: 2.1 time: 0.112944 Jun 03 09:15:29.973709 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 388/782] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:29 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:30.501998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-04d205f1-2fcc-44c3-bbf8-253f3ae18365 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'create', calling method: .version_select at 0x7fd2b13e9430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1609593355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2W4kfQ5iQ6HiTdyxyPDOlgDyODuj9sfsbMbL7aHQ5TyUdRbMuAlgo4jNbnBXxfjSrovOS4sxSV58uQ6YIv6iVM2xFO0YeiID6iDl9Dr5J9cVfXKNHdx5n8mHnKJX5UQ=="}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:30.517868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-04d205f1-2fcc-44c3-bbf8-253f3ae18365 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Getting quotas for project 6589bf32f14e4d86a3ae7ea078aba811. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:15:30.522076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-04d205f1-2fcc-44c3-bbf8-253f3ae18365 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Getting quotas for user 111c897ccc2d49c9bd28856dd6b87822 and project 6589bf32f14e4d86a3ae7ea078aba811. Resources: {'key_pairs'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:15:30.547680 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-04d205f1-2fcc-44c3-bbf8-253f3ae18365 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049723 Jun 03 09:15:30.548235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 395/783] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:15:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:15:30.598785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-618888801", "imageRef": "ba9c727c-d89e-4a41-b2e5-ba29ad638c2e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1609593355", "networks": [{"uuid": "5c62bfdf-aeea-4f83-888e-28648768650d"}]}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:30.649385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] validate_networks() for [('5c62bfdf-aeea-4f83-888e-28648768650d', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:15:30.996953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:30.997857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:31.005121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.005751 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.006889 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.007600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.049592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:15:31.049998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:15:31.050595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:15:31.051317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:15:31.051432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:15:31.065065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.065500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.066285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.066715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.092329 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Getting quotas for project 6589bf32f14e4d86a3ae7ea078aba811. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:15:31.098706 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Getting quotas for user 111c897ccc2d49c9bd28856dd6b87822 and project 6589bf32f14e4d86a3ae7ea078aba811. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:15:31.111559 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:15:31.113689 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba9c727c-d89e-4a41-b2e5-ba29ad638c2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:15:31.164487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-13079a7f-3ed7-4d25-88dd-1e82c1620ca9 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569522 Jun 03 09:15:31.170239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 389/784] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:15:31.175069 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-097efcd3-d4c4-4d2b-995e-557f890b9f34 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:31.175681 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-097efcd3-d4c4-4d2b-995e-557f890b9f34 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:31.186950 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:31.194547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e0af08bf-a36f-4978-a3ca-ec6be23c7fa9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.203216 Jun 03 09:15:31.204091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 396/785] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:30 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:31.252171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-097efcd3-d4c4-4d2b-995e-557f890b9f34 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:31.267202 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-097efcd3-d4c4-4d2b-995e-557f890b9f34 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1258 microversion: 2.1 time: 0.095719 Jun 03 09:15:31.268327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 390/786] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:31 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:31.413765 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:31.415242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:31.430591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.431183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.433360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.433966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.467084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-642fd54c-450c-48f4-bb32-6d49be162fdf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060061 Jun 03 09:15:31.468167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 397/787] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jun 3 09:15:31 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:31.532419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:31.533747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:31.541330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.543026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.544784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.545509 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.579030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:15:31.646833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-379764ba-083b-4685-ae1b-929a1e9bd2e0 req-e28db42f-fe12-4dd3-9809-d8f32114a092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3b52c3-a2c5-495b-a5ec-7fd961386271", "tag": "bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:31.656032 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-379764ba-083b-4685-ae1b-929a1e9bd2e0 req-e28db42f-fe12-4dd3-9809-d8f32114a092 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.656481 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-379764ba-083b-4685-ae1b-929a1e9bd2e0 req-e28db42f-fe12-4dd3-9809-d8f32114a092 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.666018 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3ec73256-eced-4d85-900d-3e1251e1cc40 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 204 len: 0 microversion: 2.20 time: 0.139091 Jun 03 09:15:31.670968 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 391/788] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 09:15:31 2022] DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 09:15:31.672817 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-379764ba-083b-4685-ae1b-929a1e9bd2e0 req-e28db42f-fe12-4dd3-9809-d8f32114a092 service nova] Creating event network-changed:bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6 for instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 on hv-cinder-81268 Jun 03 09:15:31.676871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:31.677814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:31.678087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-379764ba-083b-4685-ae1b-929a1e9bd2e0 req-e28db42f-fe12-4dd3-9809-d8f32114a092 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034974 Jun 03 09:15:31.679087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 398/789] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:31.685755 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.686447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.687465 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:31.688347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:31.824416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:31.832554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:31.834058 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:31.835344 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a6462814-e9b7-4019-a67d-8e68f1231ccf tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.162847 Jun 03 09:15:31.835969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 392/790] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:31 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:32.215195 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:32.215932 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:32.222256 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.222706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.223466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.223936 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.295229 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:32.295944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:32.304206 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.304660 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.305418 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.305847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.379115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:32.380881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:32.387297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7f1b5361-0dad-4d3d-8122-4c622de1e689 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1254 microversion: 2.1 time: 0.096630 Jun 03 09:15:32.388082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 393/791] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:32 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1254 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:32.389015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9348ae49-f267-42d9-9645-51d4a0ab5779 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.178968 Jun 03 09:15:32.389574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 399/792] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:32 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:32.855624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:32.856267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:32.862533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.862985 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.863865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:32.864337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:32.880287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:33.002593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:33.012057 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:33.013569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:33.014768 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-69163918-4e01-4589-b119-4909572bd993 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.163097 Jun 03 09:15:33.015446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 394/793] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:32 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:33.404670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:33.405230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:33.405591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:33.405677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:33.408099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:33.412576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:33.413021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:33.413550 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:33.413784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:33.414007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:33.414214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:33.414776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:33.415216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:33.420937 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:33.528351 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:33.536894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4078ce6a-ae41-4004-8b23-23c6d4222c89 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1318 microversion: 2.1 time: 0.136182 Jun 03 09:15:33.537469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 400/794] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:33 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:33.666299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:33.674870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-50a0dada-e923-44cb-ad69-e809daf561a1 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.273614 Jun 03 09:15:33.675458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 395/795] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:33 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:34.034464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:34.035046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:34.042351 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.042809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.044988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.045436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.255190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:34.264248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:34.265835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:34.267017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7c180aa0-dcd1-47b3-b916-8ae8a89f4c30 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1723 microversion: 2.20 time: 0.237090 Jun 03 09:15:34.282149 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 401/796] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:34 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:34.554594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:34.555234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:34.563091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.563964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.564998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.565658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.659057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-81ab4554-3b7d-47dc-b2b6-6bfbed52eeb7 req-918995ed-570a-4c54-82d0-4c7e22d474a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2aca80f-2256-4b33-921d-d9ef617926a9", "name": "network-vif-deleted", "tag": "6944e7b1-224d-4dff-8f88-a3963a93f253"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:34.668572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-81ab4554-3b7d-47dc-b2b6-6bfbed52eeb7 req-918995ed-570a-4c54-82d0-4c7e22d474a7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.669019 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-81ab4554-3b7d-47dc-b2b6-6bfbed52eeb7 req-918995ed-570a-4c54-82d0-4c7e22d474a7 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.683881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-81ab4554-3b7d-47dc-b2b6-6bfbed52eeb7 req-918995ed-570a-4c54-82d0-4c7e22d474a7 service nova] Creating event network-vif-deleted:6944e7b1-224d-4dff-8f88-a3963a93f253 for instance b2aca80f-2256-4b33-921d-d9ef617926a9 on hv-cinder-81268 Jun 03 09:15:34.692764 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-81ab4554-3b7d-47dc-b2b6-6bfbed52eeb7 req-918995ed-570a-4c54-82d0-4c7e22d474a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Jun 03 09:15:34.697947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 402/797] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:34.705403 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:34.706912 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:34.719808 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.720574 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.721473 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:34.722063 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:34.735392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:34.743946 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d8947672-9e47-4aab-bd7a-32426f530cd7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.193067 Jun 03 09:15:34.746251 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 396/798] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:34 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:34.886527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:34.894926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-52eb1cee-9a6c-49f3-9d3e-71a015be9584 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.195619 Jun 03 09:15:34.895521 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 403/799] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:34 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:35.289369 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:35.289980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:35.292454 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:35.297821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.298267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:35.299037 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.299471 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:35.365731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:35.374017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:35.375531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:35.376727 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cf4e6d0-6e3d-40be-ae95-7c217fe2f185 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.091339 Jun 03 09:15:35.377294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 397/800] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:35 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:35.762962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:35.763506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:35.770070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.770525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:35.771348 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.772115 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:35.901219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:35.908919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3a5e1b03-b41e-49e5-bdc6-3b8257b0940b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.150373 Jun 03 09:15:35.909466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 404/801] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:35 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:35.911154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:35.912081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:35.918784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.919263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:35.920094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:35.920566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:36.052573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:36.060556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cda98175-ad0a-4396-ad95-46b894f7006d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.153478 Jun 03 09:15:36.061119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 398/802] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:35 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:36.394960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:36.395505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:36.401908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:36.402697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:36.403941 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:36.404394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:36.480624 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:36.492166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:36.493992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:36.495625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4290933c-b1f7-4a06-977f-4c3ace98a93f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.104552 Jun 03 09:15:36.497544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 405/803] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:36 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:36.924805 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:36.925421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:36.931975 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:36.932424 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:36.933183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:36.934193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:37.078106 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:37.079350 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:37.082661 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:37.087839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:37.088803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:37.089850 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:37.090287 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:37.090677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-124b2be5-9570-4ca8-bc94-56269660a8d3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.169696 Jun 03 09:15:37.091491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 399/804] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:36 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:37.229639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:37.240790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0deebd7f-b0b2-4fea-9334-fcc60ec1113d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.167076 Jun 03 09:15:37.241477 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 406/805] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:37 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:37.517474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:37.518000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:37.525082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:37.525626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:37.526482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:37.527171 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:37.594363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:37.604001 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:37.605571 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:37.606742 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43bce737-8ba8-4300-986f-4020e0e7f90f tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.093632 Jun 03 09:15:37.607739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 400/806] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:37 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:38.109942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:38.110490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:38.117833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.118293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.119310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.119801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.258615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:38.260169 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:38.268474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.269303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.270482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.271144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.294559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:38.303513 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4487d0de-1e8c-49c8-8453-f9058906f734 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.197985 Jun 03 09:15:38.304475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 407/807] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:38 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:38.415080 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:38.423191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-837fbe50-8c11-4872-b6ad-2499a4b31b80 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.168907 Jun 03 09:15:38.423975 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 401/808] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:38 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:38.624229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:38.624863 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:38.632439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.632895 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.633681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:38.634121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:38.698456 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:38.707116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:38.708652 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:38.709803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-308d8890-03f7-4186-92c4-117d33b9c9be tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.089582 Jun 03 09:15:38.710356 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 408/809] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:38 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:39.320903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:39.322077 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:39.329031 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.329728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.330540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.330976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.440658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:39.441208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:39.447776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.448251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.449172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.449662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.469451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:39.477147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43104572-3aa8-42d3-8d0b-e3e51bcade45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.160232 Jun 03 09:15:39.487368 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 402/810] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:39 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:39.623544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:39.633162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a2ba5112-0676-4fa5-a254-3d6ef61977ec tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.196357 Jun 03 09:15:39.645209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 409/811] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:39 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:39.728817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:39.729526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:39.736760 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.741643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.742719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.743027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.747857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-1ca693ba-4935-4feb-a489-842855f5077d req-466d0d05-e0c3-4688-b498-da827fdb580e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3b52c3-a2c5-495b-a5ec-7fd961386271", "name": "network-vif-plugged", "status": "completed", "tag": "bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:39.756172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1ca693ba-4935-4feb-a489-842855f5077d req-466d0d05-e0c3-4688-b498-da827fdb580e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:39.756622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1ca693ba-4935-4feb-a489-842855f5077d req-466d0d05-e0c3-4688-b498-da827fdb580e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:39.776331 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-1ca693ba-4935-4feb-a489-842855f5077d req-466d0d05-e0c3-4688-b498-da827fdb580e service nova] Creating event network-vif-plugged:bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6 for instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 on hv-cinder-81268 Jun 03 09:15:39.782016 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-1ca693ba-4935-4feb-a489-842855f5077d req-466d0d05-e0c3-4688-b498-da827fdb580e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038028 Jun 03 09:15:39.783187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 410/812] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:39.825847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:39.834864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:39.841684 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:39.842906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-25f7c5ce-b1dc-427a-bba9-5ad8e9d744e0 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.118126 Jun 03 09:15:39.848218 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 403/813] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:39 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:40.495190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:40.496466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:40.503197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.503783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.504537 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.504966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.530317 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:40.645081 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:40.651747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:40.652447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:40.652927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9f7df7e9-86d6-4c5e-bc9f-34c834077390 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.162371 Jun 03 09:15:40.653528 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 411/814] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:40 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:40.659193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.659631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.660412 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.660840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.801164 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:40.808639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-219705fa-9431-4a19-ba0d-fbbfeb7e732f tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.160684 Jun 03 09:15:40.809242 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 404/815] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:40 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:40.860991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:40.861596 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:40.867597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.868082 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.868833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:40.869340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:40.945438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:40.953975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:40.955529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:40.956702 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6555800f-9672-4db5-b181-2881c620b5a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.099618 Jun 03 09:15:40.957268 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 412/816] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:40 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:41.670113 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:41.670728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:41.672580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:41.673396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=14 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:41.679800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.680253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.681045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.681477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.821560 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:41.826165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:41.826771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:41.829747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-641b729c-402b-40a7-a975-4fc8e7f1d5ff tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.163527 Jun 03 09:15:41.830326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 405/817] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:41 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:41.833322 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.833821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.834672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.835177 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.967861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:41.976628 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:41.977239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:41.983570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.983989 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.984777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:41.985261 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:41.993648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ebb7ee3a-0296-4b5f-8bca-e229922cea7c tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.171756 Jun 03 09:15:41.994241 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 413/818] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:41 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:42.052115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:42.060938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:42.062455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:42.063639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7595dfe0-1601-4a57-9f5a-fa45cf1eadb3 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.090940 Jun 03 09:15:42.064244 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 406/819] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:41 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:15:42.846523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:42.847156 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:42.853591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:42.854028 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:42.854770 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:42.855865 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:42.990307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:42.998212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1480adef-3d2b-40e1-9491-ee14e575007a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.155500 Jun 03 09:15:42.998785 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 414/820] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:42 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:43.011075 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:43.012330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:43.019124 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:43.019574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:43.020387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:43.020821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:43.082897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:43.083703 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:43.090531 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:43.090983 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:43.091784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:43.092226 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:43.160496 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:43.171457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:43.173001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:43.174181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-05657e87-cdc7-4cad-81a2-5e841e168461 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.095236 Jun 03 09:15:43.174776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 415/821] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:43 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:15:43.182820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:43.190402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dd8adef9-1b67-4462-918d-8113c87f0c8e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.183705 Jun 03 09:15:43.190957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 407/822] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:43 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:44.015022 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:44.016570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:44.025315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.025901 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.026773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.027798 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.184457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:44.192139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d696e44f-9bc7-4888-b997-67e105121f69 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.181371 Jun 03 09:15:44.192566 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:44.193385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 416/823] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:44 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:44.193504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:44.199725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.200196 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.201005 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.201433 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.207299 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:44.207942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:44.215029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.215835 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.216848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:44.217483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:44.280599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:44.289708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:44.291241 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:44.293072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a6d9338-1e62-4681-9b1d-4939d2bfd281 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.103825 Jun 03 09:15:44.293996 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 408/824] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:44 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:15:44.382090 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:44.390089 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-af5d9a19-24ed-4150-83ec-f30cd28b9b9e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.186688 Jun 03 09:15:44.390656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 417/825] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:44 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:45.209616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:45.210279 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:45.216876 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.217289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.218181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.218609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.311711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:45.312439 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:45.319020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.319471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.320257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.320696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.325679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:45.355576 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:45.363539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-041eb05e-abe2-4169-a1c3-297388111618 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.157917 Jun 03 09:15:45.364629 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 409/826] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:45 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:45.393449 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:45.402856 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:45.404671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:45.406031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ceca1826-9f0b-466d-8f09-f03b17d41179 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.098970 Jun 03 09:15:45.406943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 418/827] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:45 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:45.412439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:45.413315 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:45.420154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.420593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.421361 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:45.421785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:45.558183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:45.565688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-23a8d370-46da-42f4-ba09-db15c5b42680 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.162916 Jun 03 09:15:45.566249 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 410/828] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:45 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:46.381505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:46.382222 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:46.390046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.390608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.391459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.392060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.426630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:46.427441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:46.436147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.436969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.437768 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.438239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.441317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:46.523422 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:46.532190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:46.533982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:46.535175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dff9ad20-1ea7-4531-92a9-b06d2e172cf4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.114109 Jun 03 09:15:46.535736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 411/829] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:46 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:15:46.558969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:46.566405 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9ccefdbf-c60d-4287-9f17-f073cfe00d08 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.188869 Jun 03 09:15:46.566964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 419/830] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:46 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:46.582071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:46.582680 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:46.588778 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.589272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.590020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:46.590456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:46.725666 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:46.733609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-37c21319-6856-4e8f-8ce0-d6b80d5a4a05 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.155314 Jun 03 09:15:46.734170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 412/831] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:46 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:47.553606 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:47.554229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:47.561453 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.561896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.562649 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.563081 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.584401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:47.585009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:47.591429 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.591910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.592665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.593092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.624844 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:47.633096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:47.634601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:47.635776 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-757fe00d-adf2-447a-99f7-a99649ca9f51 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.086062 Jun 03 09:15:47.636347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 420/832] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:47 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:47.718940 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:47.726441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b96431a4-a912-449f-8f78-e9b4cb8985f1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.146459 Jun 03 09:15:47.727006 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 413/833] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:47 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:47.750678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:47.751343 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:47.757412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.757859 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.758619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:47.759051 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:47.889814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:47.897151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1d8dd36a-20c1-43c1-a289-f59b9a41496d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.150311 Jun 03 09:15:47.897755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 421/834] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:47 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:48.654519 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:48.655130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:48.662101 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.662551 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:48.663371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.663914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:48.726087 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:48.734769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:48.736317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:48.737482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b6e6e10b-8e78-4853-8de6-ff04076ef963 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.087404 Jun 03 09:15:48.738037 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 414/835] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:48 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:48.743781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:48.744525 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:48.751224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.751676 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:48.752483 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.752919 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:48.882520 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:48.890472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ccaa2c8a-e078-42a7-813d-09543ef653a5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.150774 Jun 03 09:15:48.891042 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 422/836] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:48 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:48.914510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:48.915044 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:48.921110 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.921556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:48.922312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:48.922746 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:49.054444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:49.061872 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-677f1e20-45e9-4a3f-b00f-b9759fe27be2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.151332 Jun 03 09:15:49.062445 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 415/837] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:48 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:49.755697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:49.756315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:49.762878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:49.763330 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:49.764127 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:49.764562 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:49.825827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:49.833824 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:49.835330 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:49.836572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-531d2a3b-068e-499c-ab68-3d986341370d tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.084834 Jun 03 09:15:49.837189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 423/838] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:49 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:49.906336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:49.906954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:49.913736 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:49.914185 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:49.914977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:49.915411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:50.043107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:50.050511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a9608aa9-bcc2-49b1-9c90-30a59f2cf37b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.148044 Jun 03 09:15:50.051076 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 416/839] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:49 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:50.078203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:50.078812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:50.086723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:50.087179 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:50.087991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:50.088432 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:50.217543 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:50.225003 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dfb2272f-1e00-4ece-998c-22dbc4a79d81 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.150571 Jun 03 09:15:50.225587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 424/840] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:50 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:50.854444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:50.855088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:50.861112 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:50.861556 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:50.862310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:50.862742 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:50.922966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:50.930846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:50.932383 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:50.934063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ca8b34d5-a6cc-4231-801f-08c88916f9c9 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.083549 Jun 03 09:15:50.934630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 417/841] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:50 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:51.066365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:51.067013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:51.074277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.074729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:51.075488 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.075954 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:51.204302 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:51.211622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6d53286e-b0d3-4d0c-9f3e-d3b59ad97df7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.149110 Jun 03 09:15:51.212207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 425/842] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:51 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:51.242345 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:51.242908 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:51.249642 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.250089 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:51.250856 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.251291 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:51.378085 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:51.385541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb32e886-777f-4b0f-b0e8-d086ae9bcf9d tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.147152 Jun 03 09:15:51.386115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 418/843] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:51 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:51.952217 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:51.952815 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:51.958784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.959228 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:51.960014 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:51.960444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:52.023613 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:52.032162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:52.033918 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:52.035052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3b379582-a410-47cb-ace4-ffc0f4f7e93a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.086821 Jun 03 09:15:52.035594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 426/844] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:51 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:52.228298 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:52.228857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:52.235517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:52.235999 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:52.236764 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:52.237198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:52.368594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:52.376440 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9ef7724b-41c1-4745-8af1-91f6b25b4662 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.152155 Jun 03 09:15:52.377110 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 419/845] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:52 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:52.401691 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:52.402303 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:52.408976 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:52.409423 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:52.410181 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:52.410619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:52.540852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:52.548317 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-51933b28-aad4-4dd2-ab97-dfb3e8c117a9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.150402 Jun 03 09:15:52.548885 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 427/846] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:52 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:53.053123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:53.053727 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:53.059786 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.060248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.061000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.061434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.123511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:53.131623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:53.133136 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:53.134296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4d66b782-c867-4c6e-9a87-2c5488f9c10a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1656 microversion: 2.20 time: 0.085148 Jun 03 09:15:53.134864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 420/847] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:53 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:53.393169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:53.393781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:53.399862 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.400315 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.401075 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.401506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.535295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:53.542726 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-78f12c67-f948-4f01-a7ed-f4c72296be75 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.153451 Jun 03 09:15:53.543295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 428/848] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:53 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:53.564646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:53.565252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:53.573107 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.574039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.574795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:53.575220 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:53.790099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:53.801381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-acfea9b7-b3ec-4626-a912-f0d9ee153bc9 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.240081 Jun 03 09:15:53.812671 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 421/849] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:53 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:54.154589 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:54.155099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:54.163035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.163501 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.164386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.164826 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.200425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.201122 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.201581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lazy-loading 'fault' on Instance uuid b2aca80f-2256-4b33-921d-d9ef617926a9 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:15:54.249511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:54.258442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:54.259966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22457f943fb84f0794695a132f93a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9b906119034d8ea425a5b768b39e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:54.261142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-32fac966-e84d-4c04-bf7a-881cac6040a4 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 200 len: 1371 microversion: 2.20 time: 0.112161 Jun 03 09:15:54.261929 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 429/850] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:54 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:15:54.410310 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-54cd3fa5-dc37-492a-8fb7-80b64ddcf9c9 req-f9ef5730-6c73-4c2a-99d6-fcd1af76483c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:15:54.426655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-54cd3fa5-dc37-492a-8fb7-80b64ddcf9c9 req-f9ef5730-6c73-4c2a-99d6-fcd1af76483c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.427122 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-54cd3fa5-dc37-492a-8fb7-80b64ddcf9c9 req-f9ef5730-6c73-4c2a-99d6-fcd1af76483c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.439615 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-54cd3fa5-dc37-492a-8fb7-80b64ddcf9c9 req-f9ef5730-6c73-4c2a-99d6-fcd1af76483c service nova] Creating event network-changed:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:15:54.444787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-54cd3fa5-dc37-492a-8fb7-80b64ddcf9c9 req-f9ef5730-6c73-4c2a-99d6-fcd1af76483c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039132 Jun 03 09:15:54.445392 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 422/851] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:15:54.559319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:54.560577 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:54.574116 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.574569 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.576386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.576837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.801594 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:54.809264 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ae1ef912-2908-4617-b6ca-190957b57b7d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.254503 Jun 03 09:15:54.809831 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 430/852] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:54 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:54.819375 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:54.820255 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:54.826433 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.826883 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.827649 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:54.828119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:54.961697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:54.970015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8180723a-bfef-419b-8624-92117a22954e tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.155250 Jun 03 09:15:54.970591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 423/853] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:54 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:55.279444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:55.280092 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:55.286389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.286839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:55.287598 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.288063 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:55.301782 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 HTTP/1.1 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:15:55.303437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:55.305033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'b2aca80f-2256-4b33-921d-d9ef617926a9'} Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:55.305886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:55.307284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:55.308978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:55.308978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f673ebf5-e1e5-473e-b995-1f658e89e34e tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 404 len: 111 microversion: 2.20 time: 0.029397 Jun 03 09:15:55.308978 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 431/854] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:55 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:15:55.314609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4fcd4da9-0d78-4d35-8e78-8e3fec3411bb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '.version_select at 0x7fd2b1486160>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:55.332572 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4fcd4da9-0d78-4d35-8e78-8e3fec3411bb tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418061111" status: 204 len: 0 microversion: 2.20 time: 0.021916 Jun 03 09:15:55.334521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 424/855] 10.222.0.61 () {60 vars in 1261 bytes} [Fri Jun 3 09:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418061111 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 09:15:55.826104 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:55.826674 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:55.833180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.833633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:55.834407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.834846 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:55.986758 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:55.987678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:55.994779 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.995226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:55.996612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:55.997052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:56.082490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:56.091152 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a1edd579-a345-409d-9df5-45a313a49ecf tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.269024 Jun 03 09:15:56.091736 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 432/856] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:55 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:56.209167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:56.217192 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-800452fd-6846-4b0a-a058-3303e698ed04 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1314 microversion: 2.1 time: 0.234404 Jun 03 09:15:56.217859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 425/857] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:55 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:57.107938 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.108548 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.115018 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.115468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.116257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.116693 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.233534 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.234166 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.240774 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.241146 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.241914 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.242343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.248926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:57.256652 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e3900fa9-5fb5-4f30-ad8e-706af3b9bec4 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.152585 Jun 03 09:15:57.257505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 433/858] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:57 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:57.370000 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:57.378032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a74dc711-d71a-4ca7-8103-09bdff6cfdc2 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1497 microversion: 2.1 time: 0.148976 Jun 03 09:15:57.378593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 426/859] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:57 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:15:57.576203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.576698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.582623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.583068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.583841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.584272 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.598255 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 HTTP/1.1 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:15:57.599827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.601306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'b2aca80f-2256-4b33-921d-d9ef617926a9'} Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:57.602203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.604251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.606396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:57.606396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-422d4fc7-59e4-4194-ab9b-23777e672110 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 404 len: 111 microversion: 2.20 time: 0.029110 Jun 03 09:15:57.606396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 434/860] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 09:15:57 2022] DELETE /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:15:57.610281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.610882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: b2aca80f-2256-4b33-921d-d9ef617926a9] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.616945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.617390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.618141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.618570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.632155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 HTTP/1.1 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:15:57.633814 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.635259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'b2aca80f-2256-4b33-921d-d9ef617926a9'} Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:57.636317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. Jun 03 09:15:57.637769 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:57.639650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance b2aca80f-2256-4b33-921d-d9ef617926a9 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:57.639650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-349c7ea0-a17e-4b48-869d-c9c42e764447 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9" status: 404 len: 111 microversion: 2.20 time: 0.028652 Jun 03 09:15:57.639650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 427/861] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:57 2022] GET /compute/v2.1/servers/b2aca80f-2256-4b33-921d-d9ef617926a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:15:57.825524 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.826017 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.832098 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.832549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.833307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.833742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.862425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:15:57.865290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=100 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:57.937319 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5b7a3cc7-1d12-474d-95b4-826354b19f87 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 204 len: 0 microversion: 2.1 time: 0.115344 Jun 03 09:15:57.937913 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 435/862] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:15:57 2022] DELETE /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:15:57.946200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:57.946804 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:57.953311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.953750 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:57.954502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:57.954928 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.091592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:58.100267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4bedc7bf-93f4-46ff-844e-29e7dc943dd6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1503 microversion: 2.1 time: 0.157880 Jun 03 09:15:58.100843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 428/863] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:57 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:58.274054 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:58.274754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:58.281341 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.281796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.282788 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.283231 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.414651 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:58.421964 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d4ef0331-19c0-40f1-a92b-35070944a3e3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.152199 Jun 03 09:15:58.422515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 436/864] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:58 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:58.769270 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:58.769813 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:58.776336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.776966 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.777741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.778180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.791589 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 HTTP/1.1 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:15:58.793668 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.795414 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '40730a5d-018c-47c2-96a7-2f2c6dcf1c67'} Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:58.796230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.797467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.798977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:58.798977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2c6b804c-faee-4d4f-835c-5faf4e85ab98 tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 404 len: 111 microversion: 2.20 time: 0.029688 Jun 03 09:15:58.798977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 429/865] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jun 3 09:15:58 2022] DELETE /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 03 09:15:58.803444 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:58.804085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] [instance: 40730a5d-018c-47c2-96a7-2f2c6dcf1c67] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:58.810786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.811224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.812158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:58.812441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:58.825486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] HTTP exception thrown: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Request method failure captured: Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 HTTP/1.1 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc6zPDVCRQJE4P8IllQFdgDiy-wFTc_FM-P7ieT7rAFpY9XmP4iVHcI1dRyvJjjk1ZOu9srg0i5W7fClkLzGBvlCwVN2Ru8R3kpPKBSyQGn11_yeh-BGP03ddvn9cBZzcAxcuO1kqOF7o0f45EDtzIGNwTgTlo1jOYYd9N0oExn7eeo Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:15:58.827136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd9b906119034d8ea425a5b768b39e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: fd9b906119034d8ea425a5b768b39e39 Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074667174 Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 22457f943fb84f0794695a132f93a3c3 Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074667174-project Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.829107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '40730a5d-018c-47c2-96a7-2f2c6dcf1c67'} Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:15:58.829849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. Jun 03 09:15:58.831088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:15:58.832198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] Returning 404 to user: Instance 40730a5d-018c-47c2-96a7-2f2c6dcf1c67 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:15:58.832198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3c14382c-2ec6-43a8-b4b5-d35c6ab4524a tempest-AttachVolumeShelveTestJSON-1074667174 tempest-AttachVolumeShelveTestJSON-1074667174-project] 10.222.0.61 "GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67" status: 404 len: 111 microversion: 2.20 time: 0.029016 Jun 03 09:15:58.832198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 437/866] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jun 3 09:15:58 2022] GET /compute/v2.1/servers/40730a5d-018c-47c2-96a7-2f2c6dcf1c67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 03 09:15:59.117419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:59.118335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:59.124400 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:59.124843 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:59.125596 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:59.126023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:59.357903 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:59.360235 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:59.374722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-69afcdef-d2d7-4866-a7a1-b7df0c5b339a tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1503 microversion: 2.1 time: 0.261080 Jun 03 09:15:59.375386 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 430/867] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:59 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:15:59.438656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:15:59.439382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:15:59.446309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:59.446849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:59.447645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:15:59.448117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:15:59.723892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:15:59.731377 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3398988f-1a34-4a09-9815-f562bc647aa7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.296645 Jun 03 09:15:59.732186 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 438/868] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:15:59 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:00.393255 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:00.393811 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:00.400807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:00.401176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:00.402501 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:00.402931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:00.749325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:00.750621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:00.757114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:00.757563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:00.758540 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:00.759523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:00.889465 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:00.897332 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1d735f68-2301-4469-b7a3-71cd7b6aeb8b tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1503 microversion: 2.1 time: 0.508062 Jun 03 09:16:00.897875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 431/869] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:00 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1503 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:01.072522 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:01.080327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0912f84c-a0cf-40b8-8d99-8fb5527ea9d8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.335959 Jun 03 09:16:01.080811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 439/870] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:00 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:01.419324 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-46704bd9-c44e-4cde-b4c8-ffd0923e12d5 req-8ca857f7-6f15-4858-ba56-beb3b56c6b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3b52c3-a2c5-495b-a5ec-7fd961386271", "name": "network-vif-deleted", "tag": "bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:01.428686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-46704bd9-c44e-4cde-b4c8-ffd0923e12d5 req-8ca857f7-6f15-4858-ba56-beb3b56c6b75 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:01.429132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-46704bd9-c44e-4cde-b4c8-ffd0923e12d5 req-8ca857f7-6f15-4858-ba56-beb3b56c6b75 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:01.440776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-46704bd9-c44e-4cde-b4c8-ffd0923e12d5 req-8ca857f7-6f15-4858-ba56-beb3b56c6b75 service nova] Creating event network-vif-deleted:bf04de5b-3652-4ea4-a8a0-c9060c0eb3a6 for instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 on hv-cinder-81268 Jun 03 09:16:01.446554 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-46704bd9-c44e-4cde-b4c8-ffd0923e12d5 req-8ca857f7-6f15-4858-ba56-beb3b56c6b75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Jun 03 09:16:01.451281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 432/871] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:01.914689 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:01.916006 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:01.922952 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:01.923672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:01.924635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:01.925219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:01.960671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:01.961369 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:01.961974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lazy-loading 'fault' on Instance uuid 6e3b52c3-a2c5-495b-a5ec-7fd961386271 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:16:02.007959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2fc05d9f18490c96c92f123f40a261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631f795e5b9d4d5c827da91bc1a94882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:02.015721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ef598d76-7894-4035-b49b-80b098c9d531 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 200 len: 1304 microversion: 2.1 time: 0.104832 Jun 03 09:16:02.016327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 440/872] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:01 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:02.097807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:02.098520 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:02.104916 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:02.105361 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:02.106132 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:02.106758 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:02.251079 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:02.262569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-df13dedc-e16a-4773-9499-e0c89de12143 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.168935 Jun 03 09:16:02.263791 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 433/873] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:02 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:03.034907 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:03.035526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] [instance: 6e3b52c3-a2c5-495b-a5ec-7fd961386271] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:03.042906 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:03.043361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:03.044169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:03.044638 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:03.058361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] HTTP exception thrown: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Request method failure captured: Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 HTTP/1.1 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdEcBUs9av2UGMHusyGDGC71hFsJ_O1-uSkONbXlNhwcnRgpeT9zioEwnlY7cS5pkhLGx4WRSrXb5CFuIT9HM4jTxx2nNjdT4SlkB6__z4__Sbm803W-lR8MLrK8hVnEGjoPWDvBohKXauFAh_xnK7GCIC2DZEr3m3Rnwh7GW3a37nU Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 631f795e5b9d4d5c827da91bc1a94882 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-VolumesActionsTest-2094814147 Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:16:03.059899 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/631f795e5b9d4d5c827da91bc1a94882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-VolumesActionsTest-2094814147 Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 631f795e5b9d4d5c827da91bc1a94882 Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-VolumesActionsTest-2094814147 Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-VolumesActionsTest-2094814147-project Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: ad2fc05d9f18490c96c92f123f40a261 Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-VolumesActionsTest-2094814147-project Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. Jun 03 09:16:03.061517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '6e3b52c3-a2c5-495b-a5ec-7fd961386271'} Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:16:03.062361 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. Jun 03 09:16:03.063840 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:16:03.065046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] Returning 404 to user: Instance 6e3b52c3-a2c5-495b-a5ec-7fd961386271 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:16:03.065046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fab0b947-abf6-4ae2-8197-73f8a0bc02d6 tempest-VolumesActionsTest-2094814147 tempest-VolumesActionsTest-2094814147-project] 10.222.0.61 "GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271" status: 404 len: 111 microversion: 2.1 time: 0.030489 Jun 03 09:16:03.065046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 441/874] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:03 2022] GET /compute/v2.1/servers/6e3b52c3-a2c5-495b-a5ec-7fd961386271 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:16:03.282272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:03.283790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:03.291528 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:03.292094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:03.292952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:03.293455 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:03.441457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:03.450386 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a3be94e2-be24-4b81-a2df-3ba951657a1d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.173321 Jun 03 09:16:03.451131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 434/875] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:03 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:04.039431 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ce3242fd-cf4f-4779-abff-9841ede8519b req-ea31d025-707f-4805-8fbf-d254a7972f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "name": "network-vif-plugged", "status": "completed", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:04.044088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:04.049699 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ce3242fd-cf4f-4779-abff-9841ede8519b req-ea31d025-707f-4805-8fbf-d254a7972f92 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:04.050145 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ce3242fd-cf4f-4779-abff-9841ede8519b req-ea31d025-707f-4805-8fbf-d254a7972f92 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:04.062728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ce3242fd-cf4f-4779-abff-9841ede8519b req-ea31d025-707f-4805-8fbf-d254a7972f92 service nova] Creating event network-vif-plugged:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:16:04.067618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ce3242fd-cf4f-4779-abff-9841ede8519b req-ea31d025-707f-4805-8fbf-d254a7972f92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240611 Jun 03 09:16:04.068257 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 442/876] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:04.467228 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:04.468012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:04.474917 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:04.475471 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:04.476354 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:04.476866 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:04.620289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:04.628024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d47fd265-aa77-49d0-a33f-78f37d3cd73c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.165249 Jun 03 09:16:04.628610 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 435/877] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:04 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:05.647401 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:05.650015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:05.661203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:05.662219 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:05.663645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:05.664332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:05.815981 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:05.824475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-754f647d-c64c-4ee0-98bc-e919701ec634 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.181561 Jun 03 09:16:05.825371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 443/878] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:05 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:06.843854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:06.844613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:06.849936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:06.858116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:06.859105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:06.860256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:06.860920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:07.136947 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:07.145134 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0a7a92e7-fcab-4205-bf26-f055f7cf739e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.306433 Jun 03 09:16:07.146562 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 436/879] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:06 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:08.165645 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:08.167002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:08.176324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:08.177512 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:08.179329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:08.180364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:08.361327 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:08.369347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-155d06eb-355e-4911-8d45-37a57cda04b2 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.210478 Jun 03 09:16:08.371414 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 444/880] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:08 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:08.505293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d83c2167-8957-435b-95ed-d83213034b0b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: .version_select at 0x7fd2b13ed430>, body: {"keypair": {"name": "tempest-keypair-1809737013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxqtiuDZdW+Gm4+JPUoVsuMJp+8QY5QHv5OTmD3xRZ5rBLRqVVvqj7l7veVT5D7IPg9nBRp48Z09CrHoiuhUNukadTZ+WMNLpd6x5RP99dPXYxXWlpx+oO0UU6MBca4hw=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:08.521756 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-d83c2167-8957-435b-95ed-d83213034b0b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:16:08.525972 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-d83c2167-8957-435b-95ed-d83213034b0b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:16:08.549144 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d83c2167-8957-435b-95ed-d83213034b0b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102612 Jun 03 09:16:08.549718 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 437/881] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:16:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:09.388019 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:09.389193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:09.397107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:09.397472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:09.398250 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:09.398679 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:09.559191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:09.568608 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-088ad9c7-7a8a-42cd-aa03-1f102bd6936d tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1358 microversion: 2.1 time: 0.185818 Jun 03 09:16:09.569848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 445/882] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:09 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:10.330953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-67183323", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08269d36-2d21-440c-9878-22bfd782131c"}], "security_groups": [{"name": "tempest-securitygroup--1119448314"}], "key_name": "tempest-keypair-1809737013", "user_data": "}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:10.453398 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.network.neutron [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] validate_networks() for [('08269d36-2d21-440c-9878-22bfd782131c', None, None, None, None, None)] {{(pid=117754) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:16:10.590227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:10.590945 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:10.601903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:10.602365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:10.603795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:10.605390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:10.891514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:10.902170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-38f68209-0212-4e89-8950-ddc859e9292a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1549 microversion: 2.1 time: 0.318811 Jun 03 09:16:10.904800 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 446/883] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:10 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:10.921743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:10.922683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:10.931992 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:10.941084 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:10.942158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:10.942767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.263219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:16:11.263652 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image limits 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:16:11.264181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:16:11.264593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image pref 0:0:0 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:16:11.265004 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.virt.hardware [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:16:11.279135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:11.294246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-47cf40ad-a12a-4128-b2aa-e426ada9991c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1549 microversion: 2.1 time: 0.376896 Jun 03 09:16:11.298194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 447/884] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:10 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1549 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:11.303017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.304285 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.305466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.306182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.315642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:11.324074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:11.325383 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Searching by: {'deleted': False, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811'} {{(pid=117753) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 09:16:11.333037 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.333772 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.334786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.335426 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.343924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:16:11.348617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:16:11.363653 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Going to run 1 instances... {{(pid=117754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:16:11.366942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:16:11.471775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.multi_cell_list [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117753) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 09:16:11.474092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8618e280-62bd-4892-a290-0587490f5a62 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.151611 Jun 03 09:16:11.474792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 438/885] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:16:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:16:11.485874 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-db08a9b3-cc46-4b20-9177-cb766234de97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:11.486491 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-db08a9b3-cc46-4b20-9177-cb766234de97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:11.567715 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-db08a9b3-cc46-4b20-9177-cb766234de97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:11.579114 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-db08a9b3-cc46-4b20-9177-cb766234de97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1240 microversion: 2.1 time: 0.096405 Jun 03 09:16:11.580484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 439/886] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:11 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:11.658640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3a5f5fb8-1f66-4726-be7e-8b3c7ddf5b45 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.348057 Jun 03 09:16:11.664175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 448/887] 10.222.0.61 () {58 vars in 1124 bytes} [Fri Jun 3 09:16:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:16:11.670795 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:11.671458 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:11.680540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.680993 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.684347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:11.684798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:11.915318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:11.925253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-219e8507-804c-4497-81db-a6462189eaab tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1549 microversion: 2.1 time: 0.258970 Jun 03 09:16:11.926464 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 440/888] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:11 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1549 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:12.597573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:12.598137 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:12.616401 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:12.618281 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:12.619933 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:12.620505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:12.732466 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:12.749285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9c7a6bd7-3f8c-41d9-aed5-9f6168b3c6ab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1236 microversion: 2.1 time: 0.153784 Jun 03 09:16:12.753147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 449/889] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:12 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1236 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:13.776080 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:13.778506 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:13.802026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:13.802832 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:13.811572 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:13.812500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:13.915371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:13.924975 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c8306924-5e8c-421b-ab14-409c4915b7a5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1298 microversion: 2.1 time: 0.157967 Jun 03 09:16:13.926359 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 441/890] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:13 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:13.990198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d1d0595-20b2-469e-8778-7c2e3b1854bb"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:13.992114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:14.002749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:14.003876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:14.009495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:14.010191 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:14.462217 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:14.478441 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8331e576-ec36-47de-98b9-bc1d0408d751 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492451 Jun 03 09:16:14.481342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 450/891] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:16:13 2022] POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:14.945444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:14.946234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:14.961824 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:14.963194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:14.964894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:14.965547 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:15.204027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:15.214583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-852195a8-9982-4b3d-b8dd-6e6c89cbcd63 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.275184 Jun 03 09:16:15.225858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 442/892] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:14 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:15.554406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-2c204206-b5d9-4712-8364-474bf6e9a86b req-1d1031f3-762f-4488-91b1-b85a06359732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6489d030-236d-40ce-829b-95aecdf19ff7", "tag": "86e4d17d-6903-4133-bd1a-e4a541a3b226"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:15.564771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-2c204206-b5d9-4712-8364-474bf6e9a86b req-1d1031f3-762f-4488-91b1-b85a06359732 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:15.565464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-2c204206-b5d9-4712-8364-474bf6e9a86b req-1d1031f3-762f-4488-91b1-b85a06359732 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:15.593763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-2c204206-b5d9-4712-8364-474bf6e9a86b req-1d1031f3-762f-4488-91b1-b85a06359732 service nova] Creating event network-changed:86e4d17d-6903-4133-bd1a-e4a541a3b226 for instance 6489d030-236d-40ce-829b-95aecdf19ff7 on hv-cinder-81268 Jun 03 09:16:15.619192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-2c204206-b5d9-4712-8364-474bf6e9a86b req-1d1031f3-762f-4488-91b1-b85a06359732 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070048 Jun 03 09:16:15.620683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 451/893] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:16.233272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:16.234073 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:16.242234 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:16.242773 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:16.243639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:16.244181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:16.387653 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:16.395637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bf5884d9-0240-475c-8475-2bfb4ea3b610 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.166942 Jun 03 09:16:16.396472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 443/894] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:16 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:17.415530 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:17.416375 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:17.423546 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:17.425951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:17.425951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:17.425951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:17.572757 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:17.581457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cd06a3e0-494b-441c-91fc-5839a8217212 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.170806 Jun 03 09:16:17.582635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 452/895] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:17 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:18.598645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:18.599273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:18.606624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:18.607293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:18.608263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:18.608703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:19.138567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:19.149217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-19f8eef3-26ac-4786-ab7d-d55794e89577 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.554312 Jun 03 09:16:19.150702 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 444/896] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:18 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:20.111091 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-e335de3c-b31f-4d65-b237-95d867ad651a req-51195515-6213-44f5-913c-2434030b79bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6489d030-236d-40ce-829b-95aecdf19ff7", "name": "network-vif-plugged", "status": "completed", "tag": "86e4d17d-6903-4133-bd1a-e4a541a3b226"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:20.121845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e335de3c-b31f-4d65-b237-95d867ad651a req-51195515-6213-44f5-913c-2434030b79bf service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:20.122293 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-e335de3c-b31f-4d65-b237-95d867ad651a req-51195515-6213-44f5-913c-2434030b79bf service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:20.139119 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-e335de3c-b31f-4d65-b237-95d867ad651a req-51195515-6213-44f5-913c-2434030b79bf service nova] Creating event network-vif-plugged:86e4d17d-6903-4133-bd1a-e4a541a3b226 for instance 6489d030-236d-40ce-829b-95aecdf19ff7 on hv-cinder-81268 Jun 03 09:16:20.145822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-e335de3c-b31f-4d65-b237-95d867ad651a req-51195515-6213-44f5-913c-2434030b79bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Jun 03 09:16:20.146425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 453/897] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:20.168463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:20.171115 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:20.178681 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:20.179515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:20.180230 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:20.181370 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:20.358342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:20.367677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-67d37195-0588-45e5-9b24-dcff0cf7e6fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.203579 Jun 03 09:16:20.368304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 445/898] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:20 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:21.387609 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:21.389044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:21.395548 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:21.398169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:21.398912 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:21.399962 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:21.400565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:21.570451 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:21.578497 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-532ca475-f39b-4de7-b9c6-8f3488542795 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.197000 Jun 03 09:16:21.579367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 454/899] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:21 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:22.248233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:22.249293 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:22.257190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:22.258472 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=12 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:22.262564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:22.263440 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:22.264477 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:22.265094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:22.432786 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:22.441070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-931c98be-8f02-41ec-a878-b7ca5f1b5ec0 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1595 microversion: 2.1 time: 0.199192 Jun 03 09:16:22.441645 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 446/900] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:22 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1595 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:22.602575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:22.605036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:22.614133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:22.615194 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:22.616575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:22.617235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:22.925752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:22.939243 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-06bf8ebb-f8ab-49ff-8bea-2c11885cf9cd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1366 microversion: 2.1 time: 0.346582 Jun 03 09:16:22.939859 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 455/901] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:22 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:16:23.956856 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:23.957531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:23.971011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:23.972156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:23.973190 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:23.974088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:24.262325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:24.280231 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-9331e3e0-5081-42b6-8ff0-21b35aa174bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1556 microversion: 2.1 time: 0.326512 Jun 03 09:16:24.282812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 447/902] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:23 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1556 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:16:24.300696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:24.301878 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:24.315244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:24.315731 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:24.316553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:24.316988 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:24.434945 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-92cd460a-d019-485b-bb66-00c9d9e61840 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139537 Jun 03 09:16:24.441393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 456/903] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:16:24 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:24.927623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-c9c1ca87-3594-49fc-9a4f-086205fbf21e req-27400fa3-3ee7-4180-be3f-e764ecaf6dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:24.939698 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c9c1ca87-3594-49fc-9a4f-086205fbf21e req-27400fa3-3ee7-4180-be3f-e764ecaf6dc5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:24.940708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-c9c1ca87-3594-49fc-9a4f-086205fbf21e req-27400fa3-3ee7-4180-be3f-e764ecaf6dc5 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:24.958835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-c9c1ca87-3594-49fc-9a4f-086205fbf21e req-27400fa3-3ee7-4180-be3f-e764ecaf6dc5 service nova] Creating event network-changed:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:16:24.966518 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-c9c1ca87-3594-49fc-9a4f-086205fbf21e req-27400fa3-3ee7-4180-be3f-e764ecaf6dc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043552 Jun 03 09:16:24.967998 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 448/904] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:25.913943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-f0995835-0980-404c-b1db-59cedfd054f9 req-81a79859-f0f8-4681-9a92-cfd1934076f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6489d030-236d-40ce-829b-95aecdf19ff7", "tag": "86e4d17d-6903-4133-bd1a-e4a541a3b226"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:25.922898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f0995835-0980-404c-b1db-59cedfd054f9 req-81a79859-f0f8-4681-9a92-cfd1934076f4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:25.936602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f0995835-0980-404c-b1db-59cedfd054f9 req-81a79859-f0f8-4681-9a92-cfd1934076f4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:25.956908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-f0995835-0980-404c-b1db-59cedfd054f9 req-81a79859-f0f8-4681-9a92-cfd1934076f4 service nova] Creating event network-changed:86e4d17d-6903-4133-bd1a-e4a541a3b226 for instance 6489d030-236d-40ce-829b-95aecdf19ff7 on hv-cinder-81268 Jun 03 09:16:25.968998 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-f0995835-0980-404c-b1db-59cedfd054f9 req-81a79859-f0f8-4681-9a92-cfd1934076f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146414 Jun 03 09:16:25.970591 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 457/905] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:27.438348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-618552195"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:27.439197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:27.448227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:27.449294 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:27.449729 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:27.450172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:27.677584 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.network.security_group_api [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Adding security group 07c3bcf5-eb85-4b81-9df8-ef2c16bc1777 to port 03d73a42-40f7-414e-b0bd-a76a242333c2 Jun 03 09:16:28.130739 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8b210862-afd9-470e-89fb-af617ab4f07a tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action" status: 202 len: 0 microversion: 2.1 time: 0.697059 Jun 03 09:16:28.139664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 449/906] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:16:27 2022] POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:16:28.187924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:16:28.187924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:16:28.206625 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-273e8816-e094-48e0-84dd-cd2d647d330b req-8d153e04-004d-456e-bbb6-626a7b7c5026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:16:28.207165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:28.207165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:28.207165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:28.207165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:28.207611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-273e8816-e094-48e0-84dd-cd2d647d330b req-8d153e04-004d-456e-bbb6-626a7b7c5026 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:16:28.207611 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-273e8816-e094-48e0-84dd-cd2d647d330b req-8d153e04-004d-456e-bbb6-626a7b7c5026 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:16:28.220060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-273e8816-e094-48e0-84dd-cd2d647d330b req-8d153e04-004d-456e-bbb6-626a7b7c5026 service nova] Creating event network-changed:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:16:28.225984 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-273e8816-e094-48e0-84dd-cd2d647d330b req-8d153e04-004d-456e-bbb6-626a7b7c5026 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076065 Jun 03 09:16:28.226881 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 450/907] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:16:28.479542 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:16:28.488074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-3c3b10be-0d65-4b91-9d63-8d46f4893ec5 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1760 microversion: 2.1 time: 0.351666 Jun 03 09:16:28.488897 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 458/908] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:16:28 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1760 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:23.970639 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-3b998936-7599-4ad0-97b5-0d97bb581c8b req-e27ef1a6-ffcd-4e5a-959b-b43631f0aae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7540ba8e-17a4-46e9-89c4-cae8137deb70", "tag": "70e90032-900d-4182-bf8a-bcaa28245d3a"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:23.974407 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=33 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:23.975055 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=34 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:23.979071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:23.980416 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:23.983419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:23.984193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=91 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:23.994342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-3b998936-7599-4ad0-97b5-0d97bb581c8b req-e27ef1a6-ffcd-4e5a-959b-b43631f0aae2 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:23.994790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-3b998936-7599-4ad0-97b5-0d97bb581c8b req-e27ef1a6-ffcd-4e5a-959b-b43631f0aae2 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:24.002511 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:24.002978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:24.003836 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:24.004272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:24.018712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-3b998936-7599-4ad0-97b5-0d97bb581c8b req-e27ef1a6-ffcd-4e5a-959b-b43631f0aae2 service nova] Creating event network-changed:70e90032-900d-4182-bf8a-bcaa28245d3a for instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 on hv-cinder-81268 Jun 03 09:17:24.023875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-3b998936-7599-4ad0-97b5-0d97bb581c8b req-e27ef1a6-ffcd-4e5a-959b-b43631f0aae2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056760 Jun 03 09:17:24.024492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 459/909] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:17:24.034391 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:17:24.134289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ffee5cf1-2e17-46f8-8f2a-e4ac74deeff4 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 204 len: 0 microversion: 2.1 time: 0.170245 Jun 03 09:17:24.135289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 451/910] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:17:23 2022] DELETE /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:17:24.144973 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:24.146050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:24.155183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:24.155730 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:24.157062 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:24.157529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:24.299088 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:24.306824 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d08fcccc-d1c0-460c-a5f5-2b46406bbf68 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1578 microversion: 2.1 time: 0.166566 Jun 03 09:17:24.307395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 460/911] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:24 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:25.324939 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:25.325674 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:25.331937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:25.332387 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:25.333154 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:25.333591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:25.543219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:25.550877 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3c0bc70f-7060-4689-ac2d-949e83815cce tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1578 microversion: 2.1 time: 0.230076 Jun 03 09:17:25.551374 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 452/912] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:25 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1578 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:26.568832 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:26.569566 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:26.576344 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:26.576757 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:26.577705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:26.578157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:26.655404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:26.657135 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-84f878e4-21ea-40f6-b4ae-01bc88f1ef82 req-85dbe949-0a23-426f-9e8c-d95d2f797b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7540ba8e-17a4-46e9-89c4-cae8137deb70", "name": "network-vif-deleted", "tag": "70e90032-900d-4182-bf8a-bcaa28245d3a"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:26.665184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-da048956-9bc8-4a51-8fe4-271797eec4f0 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 200 len: 1391 microversion: 2.1 time: 0.101134 Jun 03 09:17:26.665835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-84f878e4-21ea-40f6-b4ae-01bc88f1ef82 req-85dbe949-0a23-426f-9e8c-d95d2f797b1d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:26.666236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 461/913] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:26 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 1391 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:26.670543 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-84f878e4-21ea-40f6-b4ae-01bc88f1ef82 req-85dbe949-0a23-426f-9e8c-d95d2f797b1d service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:26.685851 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-84f878e4-21ea-40f6-b4ae-01bc88f1ef82 req-85dbe949-0a23-426f-9e8c-d95d2f797b1d service nova] Creating event network-vif-deleted:70e90032-900d-4182-bf8a-bcaa28245d3a for instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 on hv-cinder-81268 Jun 03 09:17:26.690593 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-84f878e4-21ea-40f6-b4ae-01bc88f1ef82 req-85dbe949-0a23-426f-9e8c-d95d2f797b1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037323 Jun 03 09:17:26.691161 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 453/914] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:17:27.684971 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:27.685578 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 7540ba8e-17a4-46e9-89c4-cae8137deb70] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:27.692035 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:27.692493 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:27.693256 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:27.693690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:27.709295 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] HTTP exception thrown: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Request method failure captured: Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 HTTP/1.1 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc918kmZdxRzMCI1CzIKmBh6gR5wDmGDVPuaSjyO7jLH-hd8n7QzXJFAKkgB2HlWM0U-8gjQKi_BEJPRZPZXh1Kt3OJi4c3re9ZAH64mV0AowxSXhnQguXAQuw0qaVwVHVkmf8BlUTalxONMKsua8nLgIyeImbIxQpWQXX9qANelQ5s Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:17:27.710916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: acbec87f607d4e00a2107c572fc68643 Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. Jun 03 09:17:27.712742 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '7540ba8e-17a4-46e9-89c4-cae8137deb70'} Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:17:27.713877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. Jun 03 09:17:27.715515 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:27.717294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Returning 404 to user: Instance 7540ba8e-17a4-46e9-89c4-cae8137deb70 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:17:27.717294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7af2de24-1ad2-4fbd-ac17-89d13da54204 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70" status: 404 len: 111 microversion: 2.1 time: 0.031744 Jun 03 09:17:27.717294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 462/915] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:27 2022] GET /compute/v2.1/servers/7540ba8e-17a4-46e9-89c4-cae8137deb70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:17:31.001930 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:31.002516 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:31.003982 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-b5084dc4-74f0-40fe-b263-6e73a3b6333f req-1c41da30-edbf-4588-8ff3-d0ddd02a05dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30102330-9ba1-483c-9283-25fae41e9c17", "tag": "05e4a310-78b5-4e1d-80e0-25fec9828098"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:31.009172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:31.009620 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:31.010430 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:31.010875 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:31.013351 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b5084dc4-74f0-40fe-b263-6e73a3b6333f req-1c41da30-edbf-4588-8ff3-d0ddd02a05dd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:31.014052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b5084dc4-74f0-40fe-b263-6e73a3b6333f req-1c41da30-edbf-4588-8ff3-d0ddd02a05dd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:31.027212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-b5084dc4-74f0-40fe-b263-6e73a3b6333f req-1c41da30-edbf-4588-8ff3-d0ddd02a05dd service nova] Creating event network-changed:05e4a310-78b5-4e1d-80e0-25fec9828098 for instance 30102330-9ba1-483c-9283-25fae41e9c17 on hv-cinder-81268 Jun 03 09:17:31.033754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-b5084dc4-74f0-40fe-b263-6e73a3b6333f req-1c41da30-edbf-4588-8ff3-d0ddd02a05dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Jun 03 09:17:31.034986 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 463/916] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:17:31.036870 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:17:31.126334 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ac4237a6-4d81-4153-ba50-a99660dbb372 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "DELETE /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 204 len: 0 microversion: 2.1 time: 0.128278 Jun 03 09:17:31.127946 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 454/917] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:17:30 2022] DELETE /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:17:31.137872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:31.138647 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:31.147290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:31.147748 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:31.148552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:31.149007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:31.374916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:31.383183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-59bda010-d05e-45c3-9c8b-f6280d8cebfc tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1578 microversion: 2.1 time: 0.250677 Jun 03 09:17:31.385333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 464/918] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:31 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1578 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:17:32.386648 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-ead04cd1-0bf4-4e80-a1d9-01bd52562da5 req-71b7e2ed-a822-4e83-9d9f-9475bde2476f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30102330-9ba1-483c-9283-25fae41e9c17", "name": "network-vif-deleted", "tag": "05e4a310-78b5-4e1d-80e0-25fec9828098"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:32.397936 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-ead04cd1-0bf4-4e80-a1d9-01bd52562da5 req-71b7e2ed-a822-4e83-9d9f-9475bde2476f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:32.398733 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-ead04cd1-0bf4-4e80-a1d9-01bd52562da5 req-71b7e2ed-a822-4e83-9d9f-9475bde2476f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:32.405076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:32.406332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:32.416679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-ead04cd1-0bf4-4e80-a1d9-01bd52562da5 req-71b7e2ed-a822-4e83-9d9f-9475bde2476f service nova] Creating event network-vif-deleted:05e4a310-78b5-4e1d-80e0-25fec9828098 for instance 30102330-9ba1-483c-9283-25fae41e9c17 on hv-cinder-81268 Jun 03 09:17:32.416922 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:32.417459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:32.419523 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:32.421025 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:32.421973 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-ead04cd1-0bf4-4e80-a1d9-01bd52562da5 req-71b7e2ed-a822-4e83-9d9f-9475bde2476f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040122 Jun 03 09:17:32.422600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 455/919] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:17:32.487606 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbec87f607d4e00a2107c572fc68643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c506ed29f8d94060bb8685604e8f3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:32.495049 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-31616742-3187-4c0e-8ccd-e4b30f578624 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 200 len: 1224 microversion: 2.1 time: 0.096881 Jun 03 09:17:32.495610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 465/920] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:32 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:17:33.512679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:33.513375 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: 30102330-9ba1-483c-9283-25fae41e9c17] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:33.519541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:33.520023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:33.520779 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:33.521214 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:33.534931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] HTTP exception thrown: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Request method failure captured: Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 HTTP/1.1 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc918kmZdxRzMCI1CzIKmBh6gR5wDmGDVPuaSjyO7jLH-hd8n7QzXJFAKkgB2HlWM0U-8gjQKi_BEJPRZPZXh1Kt3OJi4c3re9ZAH64mV0AowxSXhnQguXAQuw0qaVwVHVkmf8BlUTalxONMKsua8nLgIyeImbIxQpWQXX9qANelQ5s Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:17:33.536555 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: acbec87f607d4e00a2107c572fc68643 Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. Jun 03 09:17:33.538292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '30102330-9ba1-483c-9283-25fae41e9c17'} Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:17:33.539309 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. Jun 03 09:17:33.540656 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:33.542527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Returning 404 to user: Instance 30102330-9ba1-483c-9283-25fae41e9c17 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:17:33.542527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-97d8ad15-43a7-4b1d-b4c9-aee63b7104ed tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17" status: 404 len: 111 microversion: 2.1 time: 0.030013 Jun 03 09:17:33.542527 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 456/921] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:33 2022] GET /compute/v2.1/servers/30102330-9ba1-483c-9283-25fae41e9c17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:17:33.971623 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:33.972182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:33.978688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:33.979167 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:33.979956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:33.980390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:33.993942 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] HTTP exception thrown: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Request method failure captured: Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: DELETE /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca HTTP/1.1 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimc918kmZdxRzMCI1CzIKmBh6gR5wDmGDVPuaSjyO7jLH-hd8n7QzXJFAKkgB2HlWM0U-8gjQKi_BEJPRZPZXh1Kt3OJi4c3re9ZAH64mV0AowxSXhnQguXAQuw0qaVwVHVkmf8BlUTalxONMKsua8nLgIyeImbIxQpWQXX9qANelQ5s Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:17:33.995643 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: acbec87f607d4e00a2107c572fc68643 Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:33.997238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca'} Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:17:34.001096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.002342 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.003573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Returning 404 to user: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:17:34.003573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-58b619aa-5fdb-4b0a-8f4d-6d9ddc1630fa tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 404 len: 111 microversion: 2.1 time: 0.029271 Jun 03 09:17:34.003573 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 466/922] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:17:33 2022] DELETE /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:17:34.006138 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:34.006785 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] [instance: ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:34.013359 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:34.013805 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:34.014583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:34.015024 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:34.029612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] HTTP exception thrown: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Request method failure captured: Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca HTTP/1.1 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimc918kmZdxRzMCI1CzIKmBh6gR5wDmGDVPuaSjyO7jLH-hd8n7QzXJFAKkgB2HlWM0U-8gjQKi_BEJPRZPZXh1Kt3OJi4c3re9ZAH64mV0AowxSXhnQguXAQuw0qaVwVHVkmf8BlUTalxONMKsua8nLgIyeImbIxQpWQXX9qANelQ5s Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:17:34.031176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c506ed29f8d94060bb8685604e8f3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: c506ed29f8d94060bb8685604e8f3798 Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestVolumeBootPattern-1285008384 Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: acbec87f607d4e00a2107c572fc68643 Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestVolumeBootPattern-1285008384-project Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.033116 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': 'ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca'} Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:17:34.033980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. Jun 03 09:17:34.035421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:17:34.036953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Returning 404 to user: Instance ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:17:34.036953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-43aee6cc-e5c9-4b38-9338-576c0b2312b5 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca" status: 404 len: 111 microversion: 2.1 time: 0.030582 Jun 03 09:17:34.036953 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 457/923] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:34 2022] GET /compute/v2.1/servers/ab5c56e3-5c0a-4ce2-8431-8bdfaa4428ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:17:35.326164 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6c25e79b-b7ac-4eb6-b3af-0f5ebd150e42 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] Calling method '.version_select at 0x7fd2b1460550>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:35.351823 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6c25e79b-b7ac-4eb6-b3af-0f5ebd150e42 tempest-TestVolumeBootPattern-1285008384 tempest-TestVolumeBootPattern-1285008384-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-615997502" status: 202 len: 0 microversion: 2.1 time: 0.029897 Jun 03 09:17:35.352404 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 467/924] 10.222.0.61 () {58 vars in 1259 bytes} [Fri Jun 3 09:17:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-615997502 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:17:39.545579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:39.546580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:39.553142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:39.553580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:39.554344 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:39.554772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:39.629894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-26cdc8d3-6019-4de5-ba29-a83335518796 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action" status: 202 len: 0 microversion: 2.1 time: 0.088093 Jun 03 09:17:39.633834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 458/925] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:17:39 2022] POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:17:39.644937 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:39.645735 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:39.656114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:39.656570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:39.657607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:39.658070 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:39.924428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:39.932943 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-31f49dc9-48bb-4942-8827-f7ab8ef7ea48 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1752 microversion: 2.1 time: 0.297477 Jun 03 09:17:39.933512 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 468/926] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:39 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1752 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:17:40.951810 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:40.952507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:40.958838 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:40.959225 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:40.961895 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:40.962351 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:41.247252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:41.255669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1d6f0d9a-0f69-4a0a-b2e2-470c8d140aa1 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.309012 Jun 03 09:17:41.256287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 459/927] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:40 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:42.273197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:42.273928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:42.281183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:42.281894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:42.282661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:42.283099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:42.432415 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:42.449213 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-bc570e64-212b-497b-ba4a-44b653f5d337 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.179855 Jun 03 09:17:42.449793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 469/928] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:42 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:43.466608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:43.467131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:43.473625 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:43.474065 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:43.474815 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:43.475244 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:43.615905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:43.624228 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-38bbddba-6359-49cc-afea-6a1b29f6f06c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.162029 Jun 03 09:17:43.624787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 460/929] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:43 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:44.640709 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:44.641320 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:44.647934 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:44.648390 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:44.649152 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:44.649774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:44.798692 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:44.808284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-022475b3-c029-4727-bdfd-9a5ed9596abc tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.171452 Jun 03 09:17:44.808861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 470/930] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:44 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:45.825915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:45.826535 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:45.833043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:45.833483 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:45.834239 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:45.834665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:45.974400 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:45.982770 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-604d0d66-46d6-450f-895e-1c7bdeeaf097 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.161435 Jun 03 09:17:45.983325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 461/931] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:45 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:46.999708 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:47.000350 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:47.006839 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:47.007279 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:47.008059 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:47.008486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:47.152363 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:47.160699 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0481920b-d423-4f80-a679-58432cc244c6 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.164812 Jun 03 09:17:47.161358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 471/932] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:46 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:48.177879 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:48.178439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:48.184933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:48.185393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:48.186156 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:48.186598 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:48.343743 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:48.351806 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a73c0706-2f02-4592-aa58-5de119e512f8 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.177939 Jun 03 09:17:48.352371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 462/933] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:48 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:49.368913 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:49.369511 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:49.376110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:49.376558 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:49.377325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:49.377754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:49.524075 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:49.532712 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-22a4e72f-29dd-475c-9557-267149b8f64b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.167722 Jun 03 09:17:49.533278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 472/934] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:49 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:50.550411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:50.551032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:50.558269 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:50.558727 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:50.559481 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:50.559959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:50.701533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:50.709452 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-075e8e56-312c-4be0-9894-b4d56c043ffe tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1757 microversion: 2.1 time: 0.162992 Jun 03 09:17:50.710017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 463/935] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:50 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:51.727042 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:51.727706 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:51.734316 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:51.734756 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:51.735563 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:51.736030 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:51.877622 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:17:51.885718 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-88b3c188-549c-4de2-865d-0bda84e5a03e tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1760 microversion: 2.1 time: 0.162526 Jun 03 09:17:51.886288 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 473/936] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:17:51 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:17:53.364394 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:17:53.364964 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:53.371384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:53.371866 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:53.372629 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:53.373071 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:53.398259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b5c36f09-d78a-4c82-af68-89ac6b562fd3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037856 Jun 03 09:17:53.398834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 464/937] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:17:53 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:17:54.748759 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3664e846-0297-4dfb-a00e-81366cbfcb24"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:17:54.749815 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:17:54.752457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:54.757811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:54.758268 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:54.759069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:17:54.759510 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:17:54.763966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=69 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:54.994080 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-96ed4490-4000-4379-902d-b8bfac7bcb20 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249094 Jun 03 09:17:54.994695 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 474/938] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:17:54 2022] POST /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:02.474820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:18:02.475431 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:18:02.485276 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-554c8bed-9d0d-472a-9651-bdb3367c11e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: .version_select at 0x7fd2b134cdc0>, body: {"keypair": {"name": "tempest-keypair-1835392961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcGnMqVa92qa5c5y5bs5EqbsJgygpCUsAeHIOwzwOPapYe/H24q17Z8sfSFmmJPmp9qdP5slVpmatVvt9k0ddwOF6ceNmpkEOfXetd48KeGgKuH5MMNuAzUI7E3OVs3Qg=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:02.489677 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:02.502923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-554c8bed-9d0d-472a-9651-bdb3367c11e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:18:02.506747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-554c8bed-9d0d-472a-9651-bdb3367c11e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:18:02.532277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-554c8bed-9d0d-472a-9651-bdb3367c11e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050807 Jun 03 09:18:02.532867 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 465/939] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:18:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:03.851248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-806566562", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08269d36-2d21-440c-9878-22bfd782131c"}], "security_groups": [{"name": "tempest-securitygroup--886986111"}], "key_name": "tempest-keypair-1835392961", "user_data": "}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:03.965187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] validate_networks() for [('08269d36-2d21-440c-9878-22bfd782131c', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:18:04.425430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:18:04.425855 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:18:04.426328 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:18:04.426734 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:18:04.427143 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:18:04.436492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:04.436946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:04.437740 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:04.438180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:04.455208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:18:04.459193 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:18:04.470273 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:18:04.472699 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:18:04.519860 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7a92e897-56d5-431a-9a13-5c7bae734e97 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.674149 Jun 03 09:18:04.520418 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 475/940] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:18:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:18:04.530329 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2273697d-8b6b-4e6b-b7b7-20d4d058c55a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:04.530952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2273697d-8b6b-4e6b-b7b7-20d4d058c55a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:04.533093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:04.588973 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2273697d-8b6b-4e6b-b7b7-20d4d058c55a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:04.596767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2273697d-8b6b-4e6b-b7b7-20d4d058c55a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1241 microversion: 2.1 time: 0.070271 Jun 03 09:18:04.597334 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 466/941] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:04 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:05.614674 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:05.615974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:05.622294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:05.622980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:05.623741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:05.624406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:05.706372 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:05.715358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dfeffdc9-fcf7-4eb6-ac8d-483758cb0703 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1311 microversion: 2.1 time: 0.104879 Jun 03 09:18:05.719931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 476/942] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:05 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:06.732747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:06.733364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:06.739945 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:06.740397 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:06.741158 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:06.741594 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:06.960405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:06.969026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7a12073f-2fd7-45c0-9bfb-8bf91a49dcf8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.240615 Jun 03 09:18:06.969821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 467/943] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:06 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:07.096698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-71ac636e-a5d1-455a-8b1c-12efb06c8970 req-3566d822-a24c-4d42-ab1b-06a1587f5267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027320be-7f45-4f12-ab40-557d0a196e66", "tag": "23bdee38-3bbe-43c7-b9f8-31643073d67e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:07.110947 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-71ac636e-a5d1-455a-8b1c-12efb06c8970 req-3566d822-a24c-4d42-ab1b-06a1587f5267 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:07.111465 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-71ac636e-a5d1-455a-8b1c-12efb06c8970 req-3566d822-a24c-4d42-ab1b-06a1587f5267 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:07.123187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-71ac636e-a5d1-455a-8b1c-12efb06c8970 req-3566d822-a24c-4d42-ab1b-06a1587f5267 service nova] Creating event network-changed:23bdee38-3bbe-43c7-b9f8-31643073d67e for instance 027320be-7f45-4f12-ab40-557d0a196e66 on hv-cinder-81268 Jun 03 09:18:07.128108 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-71ac636e-a5d1-455a-8b1c-12efb06c8970 req-3566d822-a24c-4d42-ab1b-06a1587f5267 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039719 Jun 03 09:18:07.128733 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 477/944] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:07.986233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:07.988801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:07.995817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:07.996267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:07.997026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:07.997453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:08.124541 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:08.131923 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d560fa43-fc20-4987-bf33-a8373f230e6b tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.149573 Jun 03 09:18:08.132496 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 468/945] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:07 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:09.149568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:09.150267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:09.159668 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:09.160136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:09.160898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:09.161333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:09.294655 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:09.302625 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-478e5883-6ad4-47a2-a0d8-522630f5d553 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.157742 Jun 03 09:18:09.303190 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 478/946] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:09 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:10.319447 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:10.320084 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:10.326246 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:10.326686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:10.328102 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:10.328539 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:10.455439 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:10.462809 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-49ec38ac-1445-4e2e-b908-4986df5cf313 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.147162 Jun 03 09:18:10.463963 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 469/947] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:10 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:11.480588 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:11.481240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:11.487786 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:11.488240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:11.488994 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:11.489435 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:11.616709 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:11.624688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c9fa8144-187f-4574-9e56-7d641c65ffef tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.148508 Jun 03 09:18:11.625244 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 479/948] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:11 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:12.641479 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:12.642142 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:12.649120 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:12.649569 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:12.650342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:12.651335 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:12.782994 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:12.790526 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b1bfcec7-28cd-412e-89a6-cf9d64bcf04d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.152979 Jun 03 09:18:12.791172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 470/949] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:12 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:13.808018 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:13.808658 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:13.815121 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:13.815561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:13.816377 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:13.816791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:13.944774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:13.952231 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e441b4fe-97f2-4b7c-8ffe-43c43ec80dab tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.148711 Jun 03 09:18:13.956239 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 480/950] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:13 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:14.599780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-b9a4328e-4ff3-4f65-a5a5-2588185bcebc req-3823dd91-fdd4-456e-b587-09c26f51ac21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027320be-7f45-4f12-ab40-557d0a196e66", "name": "network-vif-plugged", "status": "completed", "tag": "23bdee38-3bbe-43c7-b9f8-31643073d67e"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:14.603606 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:14.610694 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b9a4328e-4ff3-4f65-a5a5-2588185bcebc req-3823dd91-fdd4-456e-b587-09c26f51ac21 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:14.611253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-b9a4328e-4ff3-4f65-a5a5-2588185bcebc req-3823dd91-fdd4-456e-b587-09c26f51ac21 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:14.622627 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-b9a4328e-4ff3-4f65-a5a5-2588185bcebc req-3823dd91-fdd4-456e-b587-09c26f51ac21 service nova] Creating event network-vif-plugged:23bdee38-3bbe-43c7-b9f8-31643073d67e for instance 027320be-7f45-4f12-ab40-557d0a196e66 on hv-cinder-81268 Jun 03 09:18:14.627608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-b9a4328e-4ff3-4f65-a5a5-2588185bcebc req-3823dd91-fdd4-456e-b587-09c26f51ac21 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Jun 03 09:18:14.628301 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 471/951] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:14.973428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:14.974041 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:14.976000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:14.976656 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:14.983572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:14.984053 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:14.984829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:14.985267 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:15.111852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:15.119888 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-a1ec6cf6-59a0-4906-a666-e89d4a1be7bd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.150052 Jun 03 09:18:15.120447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 481/952] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:14 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:16.138355 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:16.139056 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:16.145381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:16.145831 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:16.146606 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:16.147177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:16.284683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:16.292302 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a668ac88-64e3-44bc-be93-b1f31cde9cfa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1366 microversion: 2.1 time: 0.159212 Jun 03 09:18:16.293564 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 472/953] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:16 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:17.310336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:17.310980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:17.317454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:17.317908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:17.318670 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:17.319107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:17.443848 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:17.451932 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-aae85927-7a0e-4eb5-a9f2-1dde48c526f6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1557 microversion: 2.1 time: 0.145945 Jun 03 09:18:17.452499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 482/954] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:17 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:17.467822 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:17.468330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:17.474682 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:17.475130 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:17.475904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:17.476336 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:17.552074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1f8f5b75-3758-451a-ae8b-492510efe00a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088037 Jun 03 09:18:17.552664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 473/955] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:18:17 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:18.462365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ca9c1557-f0d3-420b-9ae2-844dd2b76a08 req-11805e06-4ba2-4924-8682-badd47cad5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027320be-7f45-4f12-ab40-557d0a196e66", "tag": "23bdee38-3bbe-43c7-b9f8-31643073d67e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:18.471521 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ca9c1557-f0d3-420b-9ae2-844dd2b76a08 req-11805e06-4ba2-4924-8682-badd47cad5c8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:18.471991 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ca9c1557-f0d3-420b-9ae2-844dd2b76a08 req-11805e06-4ba2-4924-8682-badd47cad5c8 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:18.482709 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ca9c1557-f0d3-420b-9ae2-844dd2b76a08 req-11805e06-4ba2-4924-8682-badd47cad5c8 service nova] Creating event network-changed:23bdee38-3bbe-43c7-b9f8-31643073d67e for instance 027320be-7f45-4f12-ab40-557d0a196e66 on hv-cinder-81268 Jun 03 09:18:18.487833 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ca9c1557-f0d3-420b-9ae2-844dd2b76a08 req-11805e06-4ba2-4924-8682-badd47cad5c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029182 Jun 03 09:18:18.488457 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 483/956] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:50.431894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:50.432644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=36 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:50.437938 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-618552195"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:50.438473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:50.445777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:50.446222 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:50.446977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:50.447412 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:50.574828 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.network.security_group_api [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Removing security group 07c3bcf5-eb85-4b81-9df8-ef2c16bc1777 from port 03d73a42-40f7-414e-b0bd-a76a242333c2 Jun 03 09:18:50.944977 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6af4c967-7bfb-43e1-9881-76248f53db64 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action" status: 202 len: 0 microversion: 2.1 time: 0.514626 Jun 03 09:18:50.946183 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 474/957] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:18:50 2022] POST /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:18:50.957368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-808629eb-dbdb-484b-9b5e-078a2265f367 req-e0eef2ee-0aad-4b51-8ef3-f51404158751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:50.966275 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:50.967683 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:50.970039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-808629eb-dbdb-484b-9b5e-078a2265f367 req-e0eef2ee-0aad-4b51-8ef3-f51404158751 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:50.970755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-808629eb-dbdb-484b-9b5e-078a2265f367 req-e0eef2ee-0aad-4b51-8ef3-f51404158751 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:51.004825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-808629eb-dbdb-484b-9b5e-078a2265f367 req-e0eef2ee-0aad-4b51-8ef3-f51404158751 service nova] Creating event network-changed:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:18:51.011996 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-808629eb-dbdb-484b-9b5e-078a2265f367 req-e0eef2ee-0aad-4b51-8ef3-f51404158751 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058584 Jun 03 09:18:51.012704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 484/958] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:52.548451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:52.548952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:52.554981 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:52.555423 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:52.556210 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:52.556644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:52.637191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lazy-loading 'services' on Instance uuid 9277cb77-e31a-48f9-b12d-c6e352e5e59d {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:18:52.710083 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-abcefd88-fdac-42a9-8abf-043223234c7b tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments/6d1d0595-20b2-469e-8778-7c2e3b1854bb" status: 202 len: 0 microversion: 2.1 time: 0.165905 Jun 03 09:18:52.710688 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 475/959] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:18:52 2022] DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments/6d1d0595-20b2-469e-8778-7c2e3b1854bb => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:18:52.720203 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:52.721218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:52.728290 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:52.728755 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:52.729572 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:52.730046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:52.768471 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-1c4d4d10-fbc5-43b9-b6ce-9fa8fe6b897c tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052933 Jun 03 09:18:52.769175 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 485/960] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:18:52 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:53.029678 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-a5e81af2-6645-4213-b4a0-e5add9df3b01 req-3ade050e-b76c-4271-a041-6e3375d0d03b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:53.038772 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a5e81af2-6645-4213-b4a0-e5add9df3b01 req-3ade050e-b76c-4271-a041-6e3375d0d03b service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:53.039208 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-a5e81af2-6645-4213-b4a0-e5add9df3b01 req-3ade050e-b76c-4271-a041-6e3375d0d03b service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:53.050848 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-a5e81af2-6645-4213-b4a0-e5add9df3b01 req-3ade050e-b76c-4271-a041-6e3375d0d03b service nova] Creating event network-changed:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:18:53.055710 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-a5e81af2-6645-4213-b4a0-e5add9df3b01 req-3ade050e-b76c-4271-a041-6e3375d0d03b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030150 Jun 03 09:18:53.056331 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 476/961] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:53.781517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:53.782360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:53.789172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:53.789652 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:53.790442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:53.790877 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:53.817955 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-588f35b5-fd99-4d9a-8de8-d7c9bfdbebec tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041298 Jun 03 09:18:53.818503 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 486/962] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:18:53 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:18:53.829817 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:53.830390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:53.836614 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:53.837064 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:53.837816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:53.838248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:53.911385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] HTTP exception thrown: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d is not attached to volume 6d1d0595-20b2-469e-8778-7c2e3b1854bb Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Request method failure captured: Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments/6d1d0595-20b2-469e-8778-7c2e3b1854bb HTTP/1.1 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdEic49adW2VjB4OKSdJXfVQNBxTWd_CMOfIi0UVXygpCuR2mgjX2XVM1Cckwx5O8-Awre3nkX8c92Y_gGvWTrDGiDCkb-irbohZQfazjkFIwJp43yGiq5x8uihzCgP-s7Cun3Bins6kAHDrXPSu0c2LdD_wNH-oFxDZ71zp38IBaeE Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 6589bf32f14e4d86a3ae7ea078aba811 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:18:53.922910 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 6589bf32f14e4d86a3ae7ea078aba811 Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-TestMinimumBasicScenario-1413214061-project Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 111c897ccc2d49c9bd28856dd6b87822 Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestMinimumBasicScenario-1413214061-project Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:18:53.924650 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d is not attached to volume 6d1d0595-20b2-469e-8778-7c2e3b1854bb Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'server_id': '9277cb77-e31a-48f9-b12d-c6e352e5e59d', 'id': '6d1d0595-20b2-469e-8778-7c2e3b1854bb'} Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6d1d0595-20b2-469e-8778-7c2e3b1854bb. Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:18:53.925637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d is not attached to volume 6d1d0595-20b2-469e-8778-7c2e3b1854bb Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d is not attached to volume 6d1d0595-20b2-469e-8778-7c2e3b1854bb Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:53.926982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Returning 404 to user: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d is not attached to volume 6d1d0595-20b2-469e-8778-7c2e3b1854bb {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:18:53.928448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a955ef3a-3c81-4f73-b34e-061faa859301 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments/6d1d0595-20b2-469e-8778-7c2e3b1854bb" status: 404 len: 154 microversion: 2.1 time: 0.099411 Jun 03 09:18:53.928448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 477/963] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:18:53 2022] DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d/os-volume_attachments/6d1d0595-20b2-469e-8778-7c2e3b1854bb => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:18:55.058234 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:55.058753 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:55.065184 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:55.065630 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:55.066385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:55.066815 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:55.092590 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:18:55.166779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-118d3669-892c-42d1-b48c-6568a1ab5824 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 204 len: 0 microversion: 2.1 time: 0.111679 Jun 03 09:18:55.167610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 487/964] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:18:55 2022] DELETE /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:18:55.175787 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:55.176421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:55.182465 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:55.183217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:55.184304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:55.184746 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:55.316759 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:55.324934 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-7cb4fb02-20d8-47f6-87f0-6c304f820813 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1555 microversion: 2.1 time: 0.153171 Jun 03 09:18:55.325821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 478/965] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:55 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:56.342874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:56.343578 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:56.350015 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:56.350464 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:56.351218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:56.351648 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:56.477072 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:56.484581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6a3ae882-dfc0-4a22-8e22-3619daa5dee3 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1555 microversion: 2.1 time: 0.146010 Jun 03 09:18:56.485142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 488/966] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:56 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:57.501337 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:57.501944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:57.508941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:57.509419 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:57.510379 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:57.511296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:57.701712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c897ccc2d49c9bd28856dd6b87822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6589bf32f14e4d86a3ae7ea078aba811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:18:57.710517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-093689fb-52cc-4ad4-b2e6-ec3cf231398f tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 200 len: 1555 microversion: 2.1 time: 0.213048 Jun 03 09:18:57.711287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 479/967] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:57 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:18:57.937873 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-89a5a34e-781d-4432-9b07-76967ef51d6f req-3edb033f-cfa2-4c35-b8fb-ca36b625f92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9277cb77-e31a-48f9-b12d-c6e352e5e59d", "name": "network-vif-deleted", "tag": "03d73a42-40f7-414e-b0bd-a76a242333c2"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:18:57.945858 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-89a5a34e-781d-4432-9b07-76967ef51d6f req-3edb033f-cfa2-4c35-b8fb-ca36b625f92f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:57.946307 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-89a5a34e-781d-4432-9b07-76967ef51d6f req-3edb033f-cfa2-4c35-b8fb-ca36b625f92f service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:57.957340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-89a5a34e-781d-4432-9b07-76967ef51d6f req-3edb033f-cfa2-4c35-b8fb-ca36b625f92f service nova] Creating event network-vif-deleted:03d73a42-40f7-414e-b0bd-a76a242333c2 for instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d on hv-cinder-81268 Jun 03 09:18:57.962144 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-89a5a34e-781d-4432-9b07-76967ef51d6f req-3edb033f-cfa2-4c35-b8fb-ca36b625f92f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186438 Jun 03 09:18:57.962725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 489/968] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:18:58.727720 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:58.728366 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] [instance: 9277cb77-e31a-48f9-b12d-c6e352e5e59d] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:18:58.735626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:58.736119 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:58.736888 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:18:58.737325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:18:58.752070 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] HTTP exception thrown: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Request method failure captured: Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d HTTP/1.1 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdEic49adW2VjB4OKSdJXfVQNBxTWd_CMOfIi0UVXygpCuR2mgjX2XVM1Cckwx5O8-Awre3nkX8c92Y_gGvWTrDGiDCkb-irbohZQfazjkFIwJp43yGiq5x8uihzCgP-s7Cun3Bins6kAHDrXPSu0c2LdD_wNH-oFxDZ71zp38IBaeE Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 6589bf32f14e4d86a3ae7ea078aba811 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:18:58.753608 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6589bf32f14e4d86a3ae7ea078aba811"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 6589bf32f14e4d86a3ae7ea078aba811 Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1413214061 Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-TestMinimumBasicScenario-1413214061-project Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 111c897ccc2d49c9bd28856dd6b87822 Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-TestMinimumBasicScenario-1413214061-project Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. Jun 03 09:18:58.755195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '9277cb77-e31a-48f9-b12d-c6e352e5e59d'} Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:18:58.756155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. Jun 03 09:18:58.757713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:18:58.759092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Returning 404 to user: Instance 9277cb77-e31a-48f9-b12d-c6e352e5e59d could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:18:58.759289 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-add361dd-85f9-44c9-ab73-85cacccf89d7 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d" status: 404 len: 111 microversion: 2.1 time: 0.035328 Jun 03 09:18:58.759882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 480/969] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:18:58 2022] GET /compute/v2.1/servers/9277cb77-e31a-48f9-b12d-c6e352e5e59d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:18:58.768579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0bae0796-0ec2-4923-875e-7adbbcfc4152 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] Calling method '.version_select at 0x7fd2b15cc790>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:18:58.790564 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0bae0796-0ec2-4923-875e-7adbbcfc4152 tempest-TestMinimumBasicScenario-1413214061 tempest-TestMinimumBasicScenario-1413214061-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609593355" status: 202 len: 0 microversion: 2.1 time: 0.026002 Jun 03 09:18:58.791136 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 490/970] 10.222.0.61 () {58 vars in 1271 bytes} [Fri Jun 3 09:18:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609593355 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:19:16.054525 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=14 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:16.054525 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:16.292512 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c7a38277-aac0-489e-a6a7-faba9f0b5631 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Action: 'create', calling method: .version_select at 0x7fd2b1541670>, body: {"keypair": {"name": "tempest-TestShelveInstance-333925914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/apzcR2iT3sFTq7IwRJnTgoBACcQQrBBC6ZPe7QrYAxdpj5HTiZ9scy1tarJT1WGfogE3VQbZy+aVJR3EYOqjoCOhYX78BRbFr85rhBgia54B634QtHJ6+oxaB/si6iA=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:16.310725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-c7a38277-aac0-489e-a6a7-faba9f0b5631 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Getting quotas for project 39196d3b3d514f458e0657ccafaf4134. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:19:16.314920 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-c7a38277-aac0-489e-a6a7-faba9f0b5631 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Getting quotas for user 9baba2d9768f4578aeda5f311964229f and project 39196d3b3d514f458e0657ccafaf4134. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:19:16.340057 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c7a38277-aac0-489e-a6a7-faba9f0b5631 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.296924 Jun 03 09:19:16.340658 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 481/971] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:19:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:39.007391 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:39.008162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:39.012565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2114616035", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-333925914", "security_groups": [{"name": "tempest-secgroup-smoke-159250351"}], "networks": [{"uuid": "6b50d28e-3c0e-42db-af2c-483a7e927423"}], "block_device_mapping_v2": [{"uuid": "f96d2695-cbb3-45a1-a891-f998b8b9a4f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:39.126655 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] validate_networks() for [('6b50d28e-3c0e-42db-af2c-483a7e927423', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:19:39.480496 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:19:39.480966 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:19:39.481438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:19:39.481838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:19:39.482240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:19:39.490957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:39.491396 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:39.492212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:39.492642 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:39.508799 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Getting quotas for project 39196d3b3d514f458e0657ccafaf4134. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:19:39.513160 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Getting quotas for user 9baba2d9768f4578aeda5f311964229f and project 39196d3b3d514f458e0657ccafaf4134. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:19:39.571894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:19:39.574128 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f96d2695-cbb3-45a1-a891-f998b8b9a4f4',volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:19:39.698460 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-104a1c49-7a88-473c-aef4-19e64f1a48dd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.692476 Jun 03 09:19:39.699102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 491/972] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:19:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:19:39.706848 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=4 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:39.708105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:39.712466 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ce438a7f-6302-4067-a9b8-3841bcb4c5f5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:39.713096 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ce438a7f-6302-4067-a9b8-3841bcb4c5f5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:39.774705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ce438a7f-6302-4067-a9b8-3841bcb4c5f5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:39.781685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ce438a7f-6302-4067-a9b8-3841bcb4c5f5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1088 microversion: 2.1 time: 0.076114 Jun 03 09:19:39.782259 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 482/973] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:39 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:40.799092 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:40.799745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:40.806141 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:40.806605 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:40.807362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:40.807822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:40.886452 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:40.893872 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b162c4db-3922-4ae4-9f1e-e386df025be4 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1204 microversion: 2.1 time: 0.099077 Jun 03 09:19:40.894436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 492/974] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:40 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:41.912276 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:41.913085 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:41.919713 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:41.920197 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:41.922441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:41.922901 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:42.026898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-b7b0d3cd-8441-4b23-bd78-d8d4717d7d41 req-22081864-2add-49ee-b620-95cb02a2ccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:42.035837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b7b0d3cd-8441-4b23-bd78-d8d4717d7d41 req-22081864-2add-49ee-b620-95cb02a2ccc4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:42.036593 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b7b0d3cd-8441-4b23-bd78-d8d4717d7d41 req-22081864-2add-49ee-b620-95cb02a2ccc4 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:42.049508 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-b7b0d3cd-8441-4b23-bd78-d8d4717d7d41 req-22081864-2add-49ee-b620-95cb02a2ccc4 service nova] Creating event network-changed:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:19:42.055157 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-b7b0d3cd-8441-4b23-bd78-d8d4717d7d41 req-22081864-2add-49ee-b620-95cb02a2ccc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Jun 03 09:19:42.055915 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 493/975] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:19:42.193730 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:42.202141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eafc8ced-6321-4391-ade7-54abb306bdac tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.293719 Jun 03 09:19:42.202719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 483/976] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:41 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:43.220238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:43.220894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:43.227066 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:43.227517 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:43.228310 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:43.228754 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:43.527681 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:43.535428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-703610e5-b15d-4339-a82c-62a7129ed5ca tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.319964 Jun 03 09:19:43.536039 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 494/977] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:43 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:44.552017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:44.552630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:44.559160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:44.559609 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:44.560401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:44.560835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:44.739166 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:44.746616 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-de50e99d-8853-4535-bc99-5ea8c13afbae tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.198504 Jun 03 09:19:44.747179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 484/978] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:44 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:45.534993 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:45.535552 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:45.542085 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.542526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.543805 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.544238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.568728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c02f505e-a25b-47ff-b0fe-148c9ee7d1bc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/ips" status: 200 len: 150 microversion: 2.1 time: 0.037579 Jun 03 09:19:45.569271 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 495/979] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:19:45 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:45.579540 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3664e846-0297-4dfb-a00e-81366cbfcb24"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:45.580703 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:45.587192 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.587640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.588473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.588941 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.665038 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: POST /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/os-volume_attachments HTTP/1.1 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 74 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:19:45.666643 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {"volumeAttachment": {"volumeId": "3664e846-0297-4dfb-a00e-81366cbfcb24"}} Jun 03 09:19:45.668846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'server_id': '027320be-7f45-4f12-ab40-557d0a196e66', 'body': {'volumeAttachment': {'volumeId': '3664e846-0297-4dfb-a00e-81366cbfcb24'}}} Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:45.669935 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:45.671441 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 400 to user: Invalid volume: volume 3664e846-0297-4dfb-a00e-81366cbfcb24 is already attached to instances: 6489d030-236d-40ce-829b-95aecdf19ff7 {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6e61c350-040b-4052-8e5b-541326bfd812 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092515 Jun 03 09:19:45.673105 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 485/980] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:19:45 2022] POST /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:19:45.677046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:45.677544 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:45.683475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.684579 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.685338 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.685775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.709328 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:19:45.762655 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:45.763318 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:45.770443 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.770886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.771639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.772095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.784224 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-7a0e4025-a15e-4fe9-ba35-5aa85df19063 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 204 len: 0 microversion: 2.1 time: 0.110601 Jun 03 09:19:45.785222 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 496/981] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:19:45 2022] DELETE /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:19:45.795225 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:45.795857 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:45.801931 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.802380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.803146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:45.803580 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:45.957520 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:45.965572 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-dc3c7c37-332e-4478-8ede-7287ac6bdc23 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.206291 Jun 03 09:19:45.966605 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 486/982] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:45 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:45.980801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:45.988859 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e42909c2-1708-466a-87fd-a7dfdb0db2a8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1681 microversion: 2.1 time: 0.199239 Jun 03 09:19:45.989429 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 497/983] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:45 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:46.982760 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:46.983371 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:46.990396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:46.991226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:46.991588 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:46.992068 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:47.005258 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:47.005874 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:47.012297 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:47.012745 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:47.013519 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:47.013955 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:47.189744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:47.193911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:47.198088 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b1c6e655-bc37-41e1-b4c8-3260bcc686ff tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.219582 Jun 03 09:19:47.198872 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 487/984] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:46 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:47.202383 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ce5a1532-e941-4642-89c1-ef3e4480f07d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1681 microversion: 2.1 time: 0.200885 Jun 03 09:19:47.202961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 498/985] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:47 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:19:48.214489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:48.215721 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:48.220960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:48.221610 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:48.225169 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:48.225847 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:48.226963 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:48.227449 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:48.228363 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:48.229013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:48.229783 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:48.230364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:48.581336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:48.589398 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e536fa27-191a-41c7-a047-26af419d179c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1614 microversion: 2.1 time: 0.372543 Jun 03 09:19:48.590597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 499/986] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:48 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1614 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:19:48.715007 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-f0a55fb9-8432-450a-88fa-e8a062e8858a req-2199b7aa-afa6-48b3-a7cf-902256488fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027320be-7f45-4f12-ab40-557d0a196e66", "name": "network-vif-deleted", "tag": "23bdee38-3bbe-43c7-b9f8-31643073d67e"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:48.716826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:48.724500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f0a55fb9-8432-450a-88fa-e8a062e8858a req-2199b7aa-afa6-48b3-a7cf-902256488fa3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:48.725118 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5c1b2184-3281-4d04-ae9b-5ac7bd24979f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.514172 Jun 03 09:19:48.725263 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f0a55fb9-8432-450a-88fa-e8a062e8858a req-2199b7aa-afa6-48b3-a7cf-902256488fa3 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:48.730375 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 488/987] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:48 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:48.741996 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-f0a55fb9-8432-450a-88fa-e8a062e8858a req-2199b7aa-afa6-48b3-a7cf-902256488fa3 service nova] Creating event network-vif-deleted:23bdee38-3bbe-43c7-b9f8-31643073d67e for instance 027320be-7f45-4f12-ab40-557d0a196e66 on hv-cinder-81268 Jun 03 09:19:48.748209 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-f0a55fb9-8432-450a-88fa-e8a062e8858a req-2199b7aa-afa6-48b3-a7cf-902256488fa3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037009 Jun 03 09:19:48.749103 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 500/988] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:19:49.606613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:49.607233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:49.613880 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:49.614325 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:49.615093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:49.615640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:49.653409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:49.653996 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:49.654852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lazy-loading 'fault' on Instance uuid 027320be-7f45-4f12-ab40-557d0a196e66 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:19:49.706026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:49.713665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-346fd65f-d8c8-4b29-96ee-0cf174b3bdc4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 200 len: 1331 microversion: 2.1 time: 0.110977 Jun 03 09:19:49.714243 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 489/989] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:49 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:49.739548 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:49.740341 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:49.744960 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:49.745725 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:49.764406 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:49.764881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:49.770820 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:49.771299 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:49.978173 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:49.988463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-32b2d1d7-2a3c-408d-8520-bd638a8c9897 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.250221 Jun 03 09:19:49.989128 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 501/990] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:49 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:50.730388 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:50.731048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:50.732878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:50.738631 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:50.739081 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:50.739878 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:50.740317 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:50.753478 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 HTTP/1.1 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:19:50.755011 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:19:50.756719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '027320be-7f45-4f12-ab40-557d0a196e66'} Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:19:50.757722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:19:50.759256 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:19:50.760763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:19:50.760763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bc8cc690-3950-4d79-8699-f43fe5e9318a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 404 len: 111 microversion: 2.1 time: 0.029931 Jun 03 09:19:50.760763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 490/991] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:50 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:19:50.765505 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-53165068-3c4f-4ee0-a4ef-41a252033b25 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '.version_select at 0x7fd2b3bbb4c0>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:50.784667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-53165068-3c4f-4ee0-a4ef-41a252033b25 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835392961" status: 202 len: 0 microversion: 2.1 time: 0.023356 Jun 03 09:19:50.785250 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 502/992] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jun 3 09:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835392961 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 09:19:51.006264 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:51.006886 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:51.013921 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.014375 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.015180 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.015749 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.166027 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:51.174125 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ab1289b8-196f-42fd-aafe-627630d60879 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.171808 Jun 03 09:19:51.174704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 491/993] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:51 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:51.453600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:51.454097 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:51.460077 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.460532 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.461318 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.461774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.545165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.objects.instance [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lazy-loading 'services' on Instance uuid 6489d030-236d-40ce-829b-95aecdf19ff7 {{(pid=117753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:19:51.623101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e9ebe964-a0a6-41b1-9936-7605103358aa tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments/3664e846-0297-4dfb-a00e-81366cbfcb24" status: 202 len: 0 microversion: 2.1 time: 0.173259 Jun 03 09:19:51.623690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 503/994] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:19:51 2022] DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments/3664e846-0297-4dfb-a00e-81366cbfcb24 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:19:51.632016 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:51.633287 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:51.639330 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.639719 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.640618 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:51.641067 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:51.672122 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-255a2438-e4a5-4bf6-b8ee-3952771a266c tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Jun 03 09:19:51.672705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 492/995] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:19:51 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:52.190757 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:52.191459 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:52.198135 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.198587 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.199870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.200309 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.329409 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:52.336926 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-deb735a7-b656-4388-bc1b-5873300bed60 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.150321 Jun 03 09:19:52.337487 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 504/996] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:52 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:52.684985 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:52.686202 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:52.694676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.695469 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.696281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.696717 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.726957 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-13e424c5-56ce-4d54-b95a-104bd4fa1970 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046452 Jun 03 09:19:52.727517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 493/997] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:19:52 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:19:52.783599 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:52.784142 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:52.790131 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.790581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.791335 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.791788 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.815903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:19:52.893990 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ff2cecf1-cfef-4a8e-bc76-4a992f09952a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 204 len: 0 microversion: 2.1 time: 0.114090 Jun 03 09:19:52.894969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 505/998] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:19:52 2022] DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:19:52.904489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:52.905246 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:52.912434 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.912962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:52.913839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:52.914386 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:53.022183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-1f2dde84-295f-45d9-a180-2c8ce2fdd741 req-04bc7c06-c8e0-48cd-906a-ccba9f6ae3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "name": "network-vif-plugged", "status": "completed", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:53.031813 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1f2dde84-295f-45d9-a180-2c8ce2fdd741 req-04bc7c06-c8e0-48cd-906a-ccba9f6ae3dd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:53.032612 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-1f2dde84-295f-45d9-a180-2c8ce2fdd741 req-04bc7c06-c8e0-48cd-906a-ccba9f6ae3dd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:53.044870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-1f2dde84-295f-45d9-a180-2c8ce2fdd741 req-04bc7c06-c8e0-48cd-906a-ccba9f6ae3dd service nova] Creating event network-vif-plugged:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:19:53.049588 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-1f2dde84-295f-45d9-a180-2c8ce2fdd741 req-04bc7c06-c8e0-48cd-906a-ccba9f6ae3dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032060 Jun 03 09:19:53.050349 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 506/999] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:53.052937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:53.061444 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8592f5e4-170c-444d-a46f-8433861ddda7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1681 microversion: 2.1 time: 0.161821 Jun 03 09:19:53.062021 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 494/1000] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:52 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:19:53.354880 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:53.356182 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:53.362428 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:53.362876 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:53.363633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:53.364099 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:53.382721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:53.493009 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:53.500883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4d7a4ab6-2c5c-4d27-8287-9c94b19b0a8d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.150600 Jun 03 09:19:53.501453 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 507/1001] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:53 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:54.079366 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:54.080015 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:54.086295 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:54.086749 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:54.087517 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:54.088017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:54.223497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:54.231246 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d9aa70a7-033b-41ee-b2ec-cfebeade1c6a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1681 microversion: 2.1 time: 0.156381 Jun 03 09:19:54.231854 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 495/1002] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:54 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:54.517814 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:54.518451 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:54.524881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:54.525328 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:54.526074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:54.526547 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:54.657206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:54.665001 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-871b7371-494f-4552-a7fa-600a1505c58d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1259 microversion: 2.1 time: 0.150995 Jun 03 09:19:54.665565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 508/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:54 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:55.249243 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:55.249865 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:55.255859 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.256320 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:55.257097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.257533 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:55.496869 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:55.504252 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8cee89a1-1c82-41ae-ae50-b737898e5feb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1681 microversion: 2.1 time: 0.259729 Jun 03 09:19:55.504821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 496/1004] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:55 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:55.682486 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:55.683126 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:55.690854 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.691494 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:55.692362 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.693112 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:55.938640 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:55.946229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cb216e8a-24dd-41db-8125-771b449af70c tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1443 microversion: 2.1 time: 0.268091 Jun 03 09:19:55.946795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 509/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:55 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1443 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:55.962100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:55.962898 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:55.969267 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.969721 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:55.970492 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:55.970924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:56.216242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-560d0ec6-539f-492b-989f-08d2c92d2e71 req-1be770fb-4dce-461f-815e-362c320b110e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6489d030-236d-40ce-829b-95aecdf19ff7", "name": "network-vif-deleted", "tag": "86e4d17d-6903-4133-bd1a-e4a541a3b226"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:56.220595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:56.233236 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-d500dfb2-2c45-4d45-a4d0-134195cf5dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1443 microversion: 2.1 time: 0.274462 Jun 03 09:19:56.234421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 497/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:55 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1443 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:56.235216 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-560d0ec6-539f-492b-989f-08d2c92d2e71 req-1be770fb-4dce-461f-815e-362c320b110e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:56.235672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-560d0ec6-539f-492b-989f-08d2c92d2e71 req-1be770fb-4dce-461f-815e-362c320b110e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:56.275518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-560d0ec6-539f-492b-989f-08d2c92d2e71 req-1be770fb-4dce-461f-815e-362c320b110e service nova] Creating event network-vif-deleted:86e4d17d-6903-4133-bd1a-e4a541a3b226 for instance 6489d030-236d-40ce-829b-95aecdf19ff7 on hv-cinder-81268 Jun 03 09:19:56.284867 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-560d0ec6-539f-492b-989f-08d2c92d2e71 req-1be770fb-4dce-461f-815e-362c320b110e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073148 Jun 03 09:19:56.287285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 510/1007] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:19:56.522326 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:56.522943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:56.530591 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:56.531041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:56.531834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:56.532442 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:56.565716 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:56.566167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:56.566798 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lazy-loading 'fault' on Instance uuid 6489d030-236d-40ce-829b-95aecdf19ff7 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:19:56.610348 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:19:56.618580 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c98b7659-7e1c-4aa3-a7be-ef8b691ddee3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 200 len: 1330 microversion: 2.1 time: 0.100072 Jun 03 09:19:56.619514 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 498/1008] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:56 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:19:57.638110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:57.638758 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:19:57.645376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:57.645825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:57.646595 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:57.647029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:57.661291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 HTTP/1.1 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:19:57.662953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:19:57.664698 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '6489d030-236d-40ce-829b-95aecdf19ff7'} Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:19:57.665763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:19:57.667386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:19:57.669485 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:19:57.669485 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-fe26c962-e594-428d-b343-986f7a56fe93 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 404 len: 111 microversion: 2.1 time: 0.032033 Jun 03 09:19:57.669485 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 511/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:19:57 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:19:57.673898 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2506f886-4ff2-435e-834d-c59951311fb9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '.version_select at 0x7fd2b14d0700>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:19:57.693166 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2506f886-4ff2-435e-834d-c59951311fb9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809737013" status: 202 len: 0 microversion: 2.1 time: 0.023046 Jun 03 09:19:57.693770 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 499/1010] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jun 3 09:19:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809737013 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:19:58.189666 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-81aaff72-0d36-4b24-af2d-397f7b32e004 req-8cafbcc8-4dca-4b35-aa7a-3ce9c3dd5979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:58.197590 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-81aaff72-0d36-4b24-af2d-397f7b32e004 req-8cafbcc8-4dca-4b35-aa7a-3ce9c3dd5979 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:19:58.198285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-81aaff72-0d36-4b24-af2d-397f7b32e004 req-8cafbcc8-4dca-4b35-aa7a-3ce9c3dd5979 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:19:58.209896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-81aaff72-0d36-4b24-af2d-397f7b32e004 req-8cafbcc8-4dca-4b35-aa7a-3ce9c3dd5979 service nova] Creating event network-changed:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:19:58.216277 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-81aaff72-0d36-4b24-af2d-397f7b32e004 req-8cafbcc8-4dca-4b35-aa7a-3ce9c3dd5979 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029452 Jun 03 09:19:58.217211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 512/1011] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:58.375091 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5737b833-1b10-4f31-a48c-738d8e87e7d0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: .version_select at 0x7fd2b119d430>, body: {"keypair": {"name": "tempest-keypair-1292119676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBapfNHVZN3I9K0g7HYRO5746rHhVHXOd5I4IAr6OaiDpdflNA1r61PFAwFn2T03fAsH/W1IbLoU7Lz8V5d88p/owoCI0nRDBAYyL6TFzjUFdULitNVRvMtgBKVJy2gWQ=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:58.389644 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-5737b833-1b10-4f31-a48c-738d8e87e7d0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:19:58.393701 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-5737b833-1b10-4f31-a48c-738d8e87e7d0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:19:58.418509 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5737b833-1b10-4f31-a48c-738d8e87e7d0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048619 Jun 03 09:19:58.419008 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 500/1012] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:19:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:19:59.846324 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1888896264", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08269d36-2d21-440c-9878-22bfd782131c"}], "security_groups": [{"name": "tempest-securitygroup--1508628491"}], "key_name": "tempest-keypair-1292119676", "user_data": "}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:19:59.946936 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] validate_networks() for [('08269d36-2d21-440c-9878-22bfd782131c', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:20:00.556056 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:20:00.556484 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:20:00.556959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:20:00.557367 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:20:00.557778 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:20:00.566479 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:00.566927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:00.567720 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:00.568188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:00.584865 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:20:00.588757 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:20:00.600207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:20:00.602527 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:20:00.646119 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b2092bf6-85de-48e7-ac53-88680cc222e2 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804991 Jun 03 09:20:00.646765 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 513/1013] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:19:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:20:00.657388 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-45fbce29-7934-4ecc-9ae0-abb737de8ff8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:00.658006 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-45fbce29-7934-4ecc-9ae0-abb737de8ff8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:00.711890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-45fbce29-7934-4ecc-9ae0-abb737de8ff8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:00.723834 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-45fbce29-7934-4ecc-9ae0-abb737de8ff8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1242 microversion: 2.1 time: 0.070404 Jun 03 09:20:00.724509 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 501/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:00 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:01.741370 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:01.741987 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:01.748526 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:01.748974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:01.749741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:01.750180 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:01.818974 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:01.826607 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-4a746bae-08f6-4b61-9269-479e4766663d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1300 microversion: 2.1 time: 0.089631 Jun 03 09:20:01.827174 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 514/1015] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:01 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:02.850735 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:02.851343 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:02.859740 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:02.860669 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:02.861753 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:02.862428 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:02.882740 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=100 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:02.984965 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-f53ad163-bf1b-461d-9628-1f752858e1ee req-23672a40-8f42-43e2-bd99-606baa371579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7abf4c-8902-44ec-a81d-b678f770aad1", "tag": "57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:20:03.001779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f53ad163-bf1b-461d-9628-1f752858e1ee req-23672a40-8f42-43e2-bd99-606baa371579 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:03.002236 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-f53ad163-bf1b-461d-9628-1f752858e1ee req-23672a40-8f42-43e2-bd99-606baa371579 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:03.018986 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-f53ad163-bf1b-461d-9628-1f752858e1ee req-23672a40-8f42-43e2-bd99-606baa371579 service nova] Creating event network-changed:57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c for instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 on hv-cinder-81268 Jun 03 09:20:03.025767 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-f53ad163-bf1b-461d-9628-1f752858e1ee req-23672a40-8f42-43e2-bd99-606baa371579 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044311 Jun 03 09:20:03.026696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 515/1016] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:20:03.146257 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:03.154724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-929c86a9-469e-42e5-9d2d-ee42391db93e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.307784 Jun 03 09:20:03.159666 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 502/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:02 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:04.172802 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:04.173509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:04.180743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:04.181188 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:04.181936 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:04.182368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:04.311395 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:04.318773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ae3d721c-0543-4199-a88e-d3c45ae4c431 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.150730 Jun 03 09:20:04.319336 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 516/1018] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:04 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:05.335486 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:05.336147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:05.342829 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:05.343274 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:05.344066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:05.344502 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:05.573744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:05.585160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-a884e63c-16b9-44db-ad37-9663b605a916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.253494 Jun 03 09:20:05.585933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 503/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:05 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:06.605769 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:06.606333 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:06.609809 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:06.613719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:06.614162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:06.614915 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:06.615347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:06.741663 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:06.749509 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8418ee87-f416-4c1f-b555-66730bff4250 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.147730 Jun 03 09:20:06.750067 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 517/1020] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:06 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:07.766273 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:07.766839 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:07.773367 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:07.773846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:07.774623 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:07.775045 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:07.906181 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:07.913531 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d01c7fb-5650-497e-94da-c761f045df83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.151288 Jun 03 09:20:07.914099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 504/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:07 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:08.930147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:08.930762 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:08.937659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:08.938046 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:08.938812 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:08.939251 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:09.073575 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:09.077233 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-95ed5c74-99de-4aa4-9bfa-a9c0232cd240 req-7c051e4f-b9b7-4e72-909e-231c97ce0247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7abf4c-8902-44ec-a81d-b678f770aad1", "name": "network-vif-plugged", "status": "completed", "tag": "57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:20:09.081834 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c204c22c-4465-4be3-ba67-6c48a0d191fc tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.155495 Jun 03 09:20:09.082447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 518/1022] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:08 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:09.088636 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-95ed5c74-99de-4aa4-9bfa-a9c0232cd240 req-7c051e4f-b9b7-4e72-909e-231c97ce0247 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:09.089155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-95ed5c74-99de-4aa4-9bfa-a9c0232cd240 req-7c051e4f-b9b7-4e72-909e-231c97ce0247 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:09.100776 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-95ed5c74-99de-4aa4-9bfa-a9c0232cd240 req-7c051e4f-b9b7-4e72-909e-231c97ce0247 service nova] Creating event network-vif-plugged:57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c for instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 on hv-cinder-81268 Jun 03 09:20:09.106606 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-95ed5c74-99de-4aa4-9bfa-a9c0232cd240 req-7c051e4f-b9b7-4e72-909e-231c97ce0247 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Jun 03 09:20:09.107401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 505/1023] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:20:10.099601 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:10.100233 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:10.107246 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:10.107697 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:10.108469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:10.108903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:10.236187 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:10.243561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-655e2863-dde4-4ec3-8ec5-57321b4cd3f4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1368 microversion: 2.1 time: 0.147730 Jun 03 09:20:10.244102 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 519/1024] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:10 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:11.258639 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:11.263462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:11.264195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:11.265967 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:11.272380 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:11.272826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:11.273588 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:11.274025 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:11.401612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:20:11.409292 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-222d82a1-6967-4c1c-acec-864c4e828afe tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1558 microversion: 2.1 time: 0.152173 Jun 03 09:20:11.409857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 506/1025] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:20:11 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:20:11.425148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:20:11.425635 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:20:11.427440 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:11.428109 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:11.435514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:11.436002 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:11.436771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:11.437208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:11.514853 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e5d72f3f-f6c5-46da-953b-da07cc14d864 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093443 Jun 03 09:20:11.515481 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 520/1026] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:20:11 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:20:12.395679 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-5f57b48b-d510-4aba-bafd-fd3a0aaab4b8 req-5ccd7a7e-d1b9-44bc-963a-150355e29e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7abf4c-8902-44ec-a81d-b678f770aad1", "tag": "57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:20:12.404725 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5f57b48b-d510-4aba-bafd-fd3a0aaab4b8 req-5ccd7a7e-d1b9-44bc-963a-150355e29e1c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:20:12.405512 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-5f57b48b-d510-4aba-bafd-fd3a0aaab4b8 req-5ccd7a7e-d1b9-44bc-963a-150355e29e1c service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:20:12.416432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-5f57b48b-d510-4aba-bafd-fd3a0aaab4b8 req-5ccd7a7e-d1b9-44bc-963a-150355e29e1c service nova] Creating event network-changed:57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c for instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 on hv-cinder-81268 Jun 03 09:20:12.421401 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-5f57b48b-d510-4aba-bafd-fd3a0aaab4b8 req-5ccd7a7e-d1b9-44bc-963a-150355e29e1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029383 Jun 03 09:20:12.422404 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 507/1027] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:27.595504 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:27.596387 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=58 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:27.656071 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:27.656570 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:27.662530 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:27.662975 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:27.663727 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:27.664192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:27.687252 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-44b54f94-902c-4f3b-83ec-e001d6223383 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/ips" status: 200 len: 149 microversion: 2.1 time: 0.093549 Jun 03 09:21:27.687811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 521/1028] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:21:27 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:28.989320 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:28.990060 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=24 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:28.994573 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72854132-6de0-4095-8ae8-fa68effd3b77"}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:28.996342 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:29.003281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:29.003726 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:29.004510 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:29.004944 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:29.237775 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6263b5c0-eff3-4e30-81ca-e245d83fbe14 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250128 Jun 03 09:21:29.238386 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 508/1029] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:21:28 2022] POST /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:36.710276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72854132-6de0-4095-8ae8-fa68effd3b77"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:36.711392 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:36.717443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:36.717894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:36.718657 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:36.719096 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:36.794957 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: POST /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments HTTP/1.1 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 74 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:21:36.796723 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {"volumeAttachment": {"volumeId": "72854132-6de0-4095-8ae8-fa68effd3b77"}} Jun 03 09:21:36.798425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'server_id': '3d7abf4c-8902-44ec-a81d-b678f770aad1', 'body': {'volumeAttachment': {'volumeId': '72854132-6de0-4095-8ae8-fa68effd3b77'}}} Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:21:36.799284 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:36.800791 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 400 to user: Invalid volume: volume 72854132-6de0-4095-8ae8-fa68effd3b77 is already attached to instances: 3d7abf4c-8902-44ec-a81d-b678f770aad1 {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-b87b40d3-2aad-4742-aec8-c2c2d36a9916 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092006 Jun 03 09:21:36.802389 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 522/1030] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:21:36 2022] POST /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:21:36.859365 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:36.859926 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:36.866475 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:36.866937 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:36.867699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:36.868168 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:36.945704 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lazy-loading 'services' on Instance uuid 3d7abf4c-8902-44ec-a81d-b678f770aad1 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:21:37.021574 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8ec23bfe-3e58-4e21-ae22-bd93f8039e77 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments/72854132-6de0-4095-8ae8-fa68effd3b77" status: 202 len: 0 microversion: 2.1 time: 0.166894 Jun 03 09:21:37.022160 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 509/1031] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:21:36 2022] DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments/72854132-6de0-4095-8ae8-fa68effd3b77 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:21:37.030717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:37.031634 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:37.038405 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:37.038845 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:37.039662 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:37.040122 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:37.070127 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-08bf937d-a59a-4c38-8efa-516fed31ae83 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Jun 03 09:21:37.070472 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 523/1032] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:21:37 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:38.083066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:38.084195 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:38.090699 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.091148 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.091946 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.092976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.121199 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e9e4a507-c636-44f8-bf30-2d3b6d88e3e6 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042940 Jun 03 09:21:38.121821 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 510/1033] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:21:38 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:21:38.177410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:38.177896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:38.184412 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.184861 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.185619 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.186529 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.210803 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:21:38.285708 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-41f2fa52-ade9-4d53-a5be-d6bb9c907c61 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 204 len: 0 microversion: 2.1 time: 0.111568 Jun 03 09:21:38.286434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 524/1034] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:21:38 2022] DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:21:38.294665 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:38.295280 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:38.301281 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.301731 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.302488 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:38.302924 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:38.433305 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:38.441332 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-5c37f8a9-4ec0-42da-903a-7095b3edd779 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1682 microversion: 2.1 time: 0.150595 Jun 03 09:21:38.441890 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 511/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:38 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:39.459784 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:39.460514 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:39.466904 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:39.468010 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:39.468773 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:39.469210 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:39.601265 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:39.609602 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-765958b4-260b-4d3c-82a7-32c6f0276b0f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1682 microversion: 2.1 time: 0.154536 Jun 03 09:21:39.610170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 525/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:39 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:40.626482 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:40.627327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:40.634039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:40.634559 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:40.635411 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:40.635993 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:40.716206 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:40.724173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f330c10a-1c55-4ae7-b369-61e91efb6da8 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 200 len: 1614 microversion: 2.1 time: 0.101595 Jun 03 09:21:40.724767 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 512/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:40 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:40.981568 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-d5bad923-2e38-48ae-9d0c-788d1b32c1de req-517ca9f3-deb1-4d6c-9a04-a617edbb14ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7abf4c-8902-44ec-a81d-b678f770aad1", "name": "network-vif-deleted", "tag": "57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:40.992473 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d5bad923-2e38-48ae-9d0c-788d1b32c1de req-517ca9f3-deb1-4d6c-9a04-a617edbb14ac service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:40.992955 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-d5bad923-2e38-48ae-9d0c-788d1b32c1de req-517ca9f3-deb1-4d6c-9a04-a617edbb14ac service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:41.008076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-d5bad923-2e38-48ae-9d0c-788d1b32c1de req-517ca9f3-deb1-4d6c-9a04-a617edbb14ac service nova] Creating event network-vif-deleted:57c3b46c-b6ea-4387-b2bf-32a49b8d4c1c for instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 on hv-cinder-81268 Jun 03 09:21:41.013447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-d5bad923-2e38-48ae-9d0c-788d1b32c1de req-517ca9f3-deb1-4d6c-9a04-a617edbb14ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035774 Jun 03 09:21:41.014770 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 526/1038] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:41.741277 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:41.741884 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:41.748636 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:41.749082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:41.749835 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:41.750268 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:41.764443 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 HTTP/1.1 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:21:41.766097 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:21:41.767728 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '3d7abf4c-8902-44ec-a81d-b678f770aad1'} Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:21:41.768858 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:21:41.770390 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:21:41.771949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:21:41.771949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1b8bcd63-81d7-4bb8-b630-550bef0f6f8a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 404 len: 111 microversion: 2.1 time: 0.030156 Jun 03 09:21:41.771949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 513/1039] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:41 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:21:41.776781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-915a0531-93eb-4bfd-8910-d6e5356b7050 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '.version_select at 0x7fd2b15cc310>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:41.796590 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-915a0531-93eb-4bfd-8910-d6e5356b7050 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292119676" status: 202 len: 0 microversion: 2.1 time: 0.023844 Jun 03 09:21:41.797166 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 527/1040] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jun 3 09:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292119676 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:21:42.426747 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fc5bfa10-895e-4769-ba56-00fd186baddf tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: .version_select at 0x7fd2b1569820>, body: {"keypair": {"name": "tempest-keypair-340299933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAB7HxUo9vYTkhu8SOFSszwWjQhoASqcaKReU1cahDRJ/iwbSkMJLPgbHTbKpRHf5n0r/z0wr2U34IxCqFyAhZArEAIdcNP8UrcWR2K5eYsXgPY8d5tUDHx4XflLo1KZQ=="}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:42.440857 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-fc5bfa10-895e-4769-ba56-00fd186baddf tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:21:42.444613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.quota [None req-fc5bfa10-895e-4769-ba56-00fd186baddf tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'key_pairs'} {{(pid=117754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:21:42.465474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fc5bfa10-895e-4769-ba56-00fd186baddf tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042647 Jun 03 09:21:42.466063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 514/1041] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jun 3 09:21:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:43.673378 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-233324142", "imageRef": "a0d8ca95-2e37-4732-a314-a96a33a01297", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08269d36-2d21-440c-9878-22bfd782131c"}], "security_groups": [{"name": "tempest-securitygroup--1537752096"}], "key_name": "tempest-keypair-340299933", "user_data": "}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:43.774704 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.network.neutron [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] validate_networks() for [('08269d36-2d21-440c-9878-22bfd782131c', None, None, None, None, None)] {{(pid=117753) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:21:43.833046 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:21:43.833617 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:21:44.141972 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:21:44.142394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image limits 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:21:44.142869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Flavor pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:21:44.143278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Image pref 0:0:0 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:21:44.143687 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.virt.hardware [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:21:44.152449 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:44.152898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:44.153688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:44.154384 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:44.171687 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:21:44.175621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.quota [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Getting quotas for user 757aa60ce15f44718b15532550e31a2e and project 63847d4652e547aaa4d7be37b0c38c52. Resources: {'cores', 'instances', 'ram'} {{(pid=117753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:21:44.186500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Going to run 1 instances... {{(pid=117753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:21:44.188849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d8ca95-2e37-4732-a314-a96a33a01297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:21:44.234912 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-deb31a7d-6520-4e06-b0d3-88090d6973f9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566275 Jun 03 09:21:44.235586 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 528/1042] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jun 3 09:21:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:21:44.246515 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6a6358ee-8954-443f-b011-e3eae6daaef1 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:44.247312 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6a6358ee-8954-443f-b011-e3eae6daaef1 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:44.304851 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6a6358ee-8954-443f-b011-e3eae6daaef1 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:44.311792 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6a6358ee-8954-443f-b011-e3eae6daaef1 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1240 microversion: 2.1 time: 0.069650 Jun 03 09:21:44.312363 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 515/1043] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:44 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:45.328749 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:45.329499 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:45.336894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:45.337340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:45.338101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:45.338535 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:45.398565 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:45.406208 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-07e9a849-80b5-4acc-a54b-7636b7e63973 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1298 microversion: 2.1 time: 0.081367 Jun 03 09:21:45.406763 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 529/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:45 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:46.422577 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:46.423646 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:46.430456 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:46.431082 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:46.432026 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:46.432467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:46.619104 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:46.627880 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c6219716-a98d-42eb-83cf-7c5b74279d1f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.209182 Jun 03 09:21:46.628463 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 516/1045] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:46 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:46.684892 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ec7a8f53-dd4e-40fe-86b2-c38d0b065c3d req-b7b24188-f7af-433f-a227-6f31b7507e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86606859-da2d-4afd-8df2-5ed0cfcc0a0a", "tag": "eb1fd950-0167-431e-8233-3e8cc4f53538"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:46.694720 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ec7a8f53-dd4e-40fe-86b2-c38d0b065c3d req-b7b24188-f7af-433f-a227-6f31b7507e5b service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:46.695241 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ec7a8f53-dd4e-40fe-86b2-c38d0b065c3d req-b7b24188-f7af-433f-a227-6f31b7507e5b service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:46.710690 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ec7a8f53-dd4e-40fe-86b2-c38d0b065c3d req-b7b24188-f7af-433f-a227-6f31b7507e5b service nova] Creating event network-changed:eb1fd950-0167-431e-8233-3e8cc4f53538 for instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a on hv-cinder-81268 Jun 03 09:21:46.715689 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ec7a8f53-dd4e-40fe-86b2-c38d0b065c3d req-b7b24188-f7af-433f-a227-6f31b7507e5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035540 Jun 03 09:21:46.716434 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 530/1046] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:47.645451 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:47.646066 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:47.652670 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:47.653123 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:47.653885 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:47.654578 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:47.784724 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:47.792263 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-eb714dea-1de9-4b4a-97c9-7105fbfe47c0 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.150806 Jun 03 09:21:47.792832 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 517/1047] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:47 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:48.810199 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:48.810894 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:48.817621 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:48.818068 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:48.818824 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:48.819262 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:48.948117 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:48.956130 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-ea9e1bba-3ab6-4d29-8a97-5c6d2d882447 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.150685 Jun 03 09:21:48.956696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 531/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:48 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:49.973489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:49.974019 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:49.980425 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:49.980866 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:49.981622 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:49.982052 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:50.183012 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:50.191846 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6affa021-85c5-4b45-898a-1ea42322cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.222307 Jun 03 09:21:50.192410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 518/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:49 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:51.208801 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:51.209347 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:51.215774 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:51.216226 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:51.216977 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:51.217410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:51.342285 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:51.349793 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-db15b95b-050e-4620-a2f7-5608855a32e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.144913 Jun 03 09:21:51.350364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 532/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:51 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:51.700928 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-9ab8b00d-2ebf-4876-85ac-075d2d0b1042 req-32283f52-c888-4e29-9a05-195030316733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86606859-da2d-4afd-8df2-5ed0cfcc0a0a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1fd950-0167-431e-8233-3e8cc4f53538"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:51.709913 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9ab8b00d-2ebf-4876-85ac-075d2d0b1042 req-32283f52-c888-4e29-9a05-195030316733 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:51.710385 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-9ab8b00d-2ebf-4876-85ac-075d2d0b1042 req-32283f52-c888-4e29-9a05-195030316733 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:51.721652 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-9ab8b00d-2ebf-4876-85ac-075d2d0b1042 req-32283f52-c888-4e29-9a05-195030316733 service nova] Creating event network-vif-plugged:eb1fd950-0167-431e-8233-3e8cc4f53538 for instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a on hv-cinder-81268 Jun 03 09:21:51.726490 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-9ab8b00d-2ebf-4876-85ac-075d2d0b1042 req-32283f52-c888-4e29-9a05-195030316733 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088740 Jun 03 09:21:51.727063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 519/1051] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:52.366340 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:52.366953 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:52.373908 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:52.374360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:52.375120 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:52.375555 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:52.502911 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:52.510308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-260439d6-397e-4338-98f6-ba0073f418da tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.147854 Jun 03 09:21:52.510869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 533/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:52 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:53.528676 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:53.530260 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:53.536504 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:53.536956 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:53.537712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:53.538147 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:53.666918 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:53.674976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-8e3e5a0d-06ca-4bce-aceb-263459adc776 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1366 microversion: 2.1 time: 0.151098 Jun 03 09:21:53.675548 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 520/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:53 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:54.691829 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:54.692454 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:54.694858 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:54.695508 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell0:SELECT=6 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:54.701379 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:54.701823 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:54.703222 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:54.703659 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:54.837822 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:21:54.845172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9799b526-36a7-456e-b465-3984f3403b87 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1556 microversion: 2.1 time: 0.157265 Jun 03 09:21:54.845727 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 534/1054] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:21:54 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:21:54.861232 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:21:54.861741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:21:54.863626 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell0:SELECT=6 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:54.869503 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:54.869949 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:54.870708 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:54.871155 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:54.947550 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-86887540-b0ab-4a25-9ac8-cf2e73bdd822 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090150 Jun 03 09:21:54.948177 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 521/1055] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jun 3 09:21:54 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:21:56.099941 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-24237f13-cd4c-4ca8-988d-f4054de63cfb req-b7150ca6-ae28-4466-9d60-7b6b12dd0e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86606859-da2d-4afd-8df2-5ed0cfcc0a0a", "tag": "eb1fd950-0167-431e-8233-3e8cc4f53538"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:21:56.108355 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-24237f13-cd4c-4ca8-988d-f4054de63cfb req-b7150ca6-ae28-4466-9d60-7b6b12dd0e17 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:21:56.108795 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-24237f13-cd4c-4ca8-988d-f4054de63cfb req-b7150ca6-ae28-4466-9d60-7b6b12dd0e17 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:21:56.119561 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-24237f13-cd4c-4ca8-988d-f4054de63cfb req-b7150ca6-ae28-4466-9d60-7b6b12dd0e17 service nova] Creating event network-changed:eb1fd950-0167-431e-8233-3e8cc4f53538 for instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a on hv-cinder-81268 Jun 03 09:21:56.125069 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-24237f13-cd4c-4ca8-988d-f4054de63cfb req-b7150ca6-ae28-4466-9d60-7b6b12dd0e17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028757 Jun 03 09:21:56.125661 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 535/1056] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:22:15.520971 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:15.521780 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:15.526217 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:22:15.526752 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:15.535426 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:15.535915 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:15.536685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:15.537122 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:15.560473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lazy-loading 'flavor' on Instance uuid d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:22:15.632613 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-44d3d473-8fc0-4c7e-8a24-ae68425400a5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "POST /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7/action" status: 202 len: 0 microversion: 2.1 time: 0.112747 Jun 03 09:22:15.633191 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 522/1057] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:22:15 2022] POST /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:22:15.643425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:15.644230 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:15.646393 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:15.647162 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:15.652667 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:15.653113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:15.654123 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:15.654553 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:15.797672 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:15.805153 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-cc23b41b-36a2-4ef4-89c5-f01d17d3aa39 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.166640 Jun 03 09:22:15.805715 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 536/1058] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:15 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:16.823099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:16.823820 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:16.831311 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:16.831790 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:16.832542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:16.832976 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:16.962200 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:16.970393 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-f0caf1f7-d13d-42db-a7b1-a7577360b0da tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.151531 Jun 03 09:22:16.970954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 523/1059] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:16 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:17.988133 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:17.988730 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:17.995138 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:17.995582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:17.996357 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:17.996796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:18.127881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:18.135329 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-e41d292b-fa8f-4425-b8bb-9c9f05adb304 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.151639 Jun 03 09:22:18.135903 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 537/1060] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:17 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:19.152179 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:19.152794 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:19.159624 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:19.160048 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:19.160809 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:19.161248 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:19.291360 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:19.299297 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-b60df8f8-7eac-4ff2-9e51-c8d7e68b6122 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.151042 Jun 03 09:22:19.299882 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 524/1061] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:19 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:20.316582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:20.317197 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:20.323781 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:20.324245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:20.325005 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:20.325478 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:20.451332 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:20.458722 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-63c636d9-0617-4c11-b75f-19a9b770ceb0 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.146464 Jun 03 09:22:20.459282 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 538/1062] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:20 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:21.475388 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:21.476039 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:21.482507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:21.482958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:21.483714 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:21.484683 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:21.615357 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:21.622783 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-acd49a7c-4c2c-4b30-a8ef-13d89e72c22b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.151278 Jun 03 09:22:21.623347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 525/1063] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:21 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:22.639442 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:22.640060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:22.647027 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:22.647498 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:22.648283 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:22.648717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:22.776475 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:22.784430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-f9803416-d175-4906-85bf-745d9b9f879a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.148797 Jun 03 09:22:22.784993 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 539/1064] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:22 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:23.801303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:23.801906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:23.808422 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:23.808863 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:23.809607 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:23.810032 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:23.941426 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:23.948741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6cfa107e-ee2d-402d-afb8-0a23daa4a39a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.151273 Jun 03 09:22:23.949304 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 526/1065] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:23 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:24.966207 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:24.966806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:24.973229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:24.973671 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:24.974413 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:24.974837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:25.106536 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:25.114582 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-5413fa00-0699-41c3-a0e1-a78a8307bca2 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.152181 Jun 03 09:22:25.115147 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 540/1066] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:24 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:26.131860 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:26.132529 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:26.139182 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:26.139630 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:26.141023 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:26.141722 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:26.377175 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:26.384692 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-40bdc539-d613-41ad-93f8-5c47edb82586 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.256881 Jun 03 09:22:26.385378 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 527/1067] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:26 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:27.402306 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:27.402916 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:27.410368 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:27.410816 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:27.411569 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:27.412036 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:27.543423 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:27.550869 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-34e692e5-dc10-4f08-96ce-9f707c53d61e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.152411 Jun 03 09:22:27.551436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 541/1068] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:27 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:28.568053 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:28.568712 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:28.575249 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.575701 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.576558 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.577020 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.710487 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:28.718245 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-482cb945-784d-4094-bc3b-63ed3f11bf98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1569 microversion: 2.1 time: 0.154135 Jun 03 09:22:28.719495 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 528/1069] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:28 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:22:28.735628 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:22:28.736232 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:28.742688 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.743137 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.743924 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.744360 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.816495 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-9001a9b3-99d5-4bb8-99e8-e6b50936b12d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "POST /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7/action" status: 202 len: 0 microversion: 2.1 time: 0.084669 Jun 03 09:22:28.817101 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 542/1070] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jun 3 09:22:28 2022] POST /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:22:28.825227 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:28.825771 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:28.832299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.832748 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.833513 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:28.833943 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:28.967958 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:28.976010 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-0fab3bc9-800d-4872-8cc4-8a531ce67f88 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1517 microversion: 2.1 time: 0.154671 Jun 03 09:22:28.976570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 529/1071] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:28 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:29.994092 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:29.994779 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:30.000875 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:30.001325 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:30.002250 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:30.002804 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:30.131443 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:30.138685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-304bb4f5-3906-4fa7-9757-663dcae9177a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1517 microversion: 2.1 time: 0.149199 Jun 03 09:22:30.139242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 543/1072] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:29 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:31.156374 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:31.156880 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:31.163542 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:31.164022 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:31.164840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:31.165271 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:31.297659 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:31.305299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-bb87e97f-a212-4629-bf28-ba7a95350c06 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1517 microversion: 2.1 time: 0.153208 Jun 03 09:22:31.305864 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 530/1073] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:31 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:31.772132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-826691e8-f315-46d5-8d53-ac8786f91c5c req-314d1178-3de1-4490-bfbf-d057a6ccfecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "name": "network-vif-unplugged", "status": "completed", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:22:31.780606 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-826691e8-f315-46d5-8d53-ac8786f91c5c req-314d1178-3de1-4490-bfbf-d057a6ccfecd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:31.781753 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-826691e8-f315-46d5-8d53-ac8786f91c5c req-314d1178-3de1-4490-bfbf-d057a6ccfecd service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:31.793107 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.compute.server_external_events [req-826691e8-f315-46d5-8d53-ac8786f91c5c req-314d1178-3de1-4490-bfbf-d057a6ccfecd service nova] Unable to find a host for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7. Dropping event network-vif-unplugged {{(pid=117753) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 09:22:31.793969 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-826691e8-f315-46d5-8d53-ac8786f91c5c req-314d1178-3de1-4490-bfbf-d057a6ccfecd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025663 Jun 03 09:22:31.794811 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 544/1074] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 09:22:32.322172 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:32.322782 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:32.329198 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:32.329651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:32.330409 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:32.330840 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:32.460849 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:32.468299 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3796c907-a26a-44da-b483-c88fa531225d tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1517 microversion: 2.1 time: 0.150020 Jun 03 09:22:32.469468 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 531/1075] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:32 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:33.484868 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:33.485469 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:33.492013 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:33.492456 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:33.493263 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:33.493696 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:33.622750 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:33.630673 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6973fdf7-505f-4335-bac6-e8634cd65efc tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1519 microversion: 2.1 time: 0.149651 Jun 03 09:22:33.631227 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 545/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:33 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:34.648373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:34.648978 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:34.655578 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:34.656063 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:34.657373 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:34.657807 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:34.857072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:34.864763 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ed719523-a6b2-4a0a-b8a2-42633c4aa082 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.220208 Jun 03 09:22:34.865523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 532/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:34 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:35.881852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:35.882463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:35.888989 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:35.889438 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:35.890192 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:35.890628 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:36.024410 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:36.032609 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-99dbb996-bdc0-4bfd-af02-96d50fc9f55f tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.154656 Jun 03 09:22:36.033173 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 546/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:35 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:37.049980 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:37.050598 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:37.057328 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:37.057801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:37.058545 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:37.058982 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:37.185570 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:37.193585 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2d1e8147-4d36-467c-b2ca-d197b5edae52 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.147983 Jun 03 09:22:37.194157 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 533/1079] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:37 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:38.210482 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:38.211087 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:38.218060 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:38.218508 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:38.219768 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:38.220215 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:38.349276 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:38.356734 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c8117341-05b7-4e7e-969b-345f338d86c5 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.150194 Jun 03 09:22:38.357308 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 547/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:38 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:39.374108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:39.374721 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:39.381855 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:39.382305 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:39.383089 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:39.383523 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:39.511072 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:39.518567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-fea1582d-e059-4ec7-b7c5-541c68edfa7b tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.148311 Jun 03 09:22:39.519131 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 534/1081] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:39 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:40.535253 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:40.535881 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:40.542346 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:40.542796 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:40.543549 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:40.544020 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:40.671896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:40.679806 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8a38fc83-0134-43e0-b2f7-96f231e65bdd tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.148418 Jun 03 09:22:40.680382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 548/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:40 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:41.697314 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:41.697931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:41.704497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:41.704954 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:41.706478 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:41.706816 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:41.839043 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:41.846606 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c06e7099-6101-481c-8e87-d6ece58ea299 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.153178 Jun 03 09:22:41.847176 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 535/1083] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:41 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:42.863633 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:42.864278 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:42.871386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:42.871945 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:42.872810 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:42.873242 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:43.001753 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:43.009158 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8a03773f-059a-42e6-a473-f2b95f954924 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.149402 Jun 03 09:22:43.009719 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 549/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:42 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:44.026446 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:44.027074 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:44.033830 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:44.034777 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:44.035537 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:44.036003 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:44.054381 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:44.170744 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:44.179286 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-4734ced1-69ee-47fc-9c1b-32f6a8cb3837 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.156785 Jun 03 09:22:44.179871 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 536/1085] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:44 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:45.196664 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:45.197218 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:45.203701 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:45.204245 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:45.205000 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:45.205436 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:45.333447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:45.340870 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-66cf60cd-04ad-4593-af14-b05e290e2325 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.148123 Jun 03 09:22:45.341430 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 550/1086] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:45 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:45.980170 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [req-222fc279-9557-4e72-b886-901ae6ea044e req-a6bc1de7-fc0d-4691-99c6-7abd073e9d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "name": "network-vif-plugged", "status": "completed", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:22:45.984093 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=31 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:45.991933 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-222fc279-9557-4e72-b886-901ae6ea044e req-a6bc1de7-fc0d-4691-99c6-7abd073e9d6e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:45.993148 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [req-222fc279-9557-4e72-b886-901ae6ea044e req-a6bc1de7-fc0d-4691-99c6-7abd073e9d6e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:46.005410 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.compute.server_external_events [req-222fc279-9557-4e72-b886-901ae6ea044e req-a6bc1de7-fc0d-4691-99c6-7abd073e9d6e service nova] Creating event network-vif-plugged:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:22:46.011062 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [req-222fc279-9557-4e72-b886-901ae6ea044e req-a6bc1de7-fc0d-4691-99c6-7abd073e9d6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Jun 03 09:22:46.011664 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 537/1087] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:22:46.358132 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:46.358743 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:46.361041 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=33 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:46.366898 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:46.367339 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:46.368114 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:46.368545 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:46.371229 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:46.497907 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:46.505298 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-c7539844-9938-4385-88af-e2cca8dd6a28 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.151076 Jun 03 09:22:46.505856 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 551/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:46 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:47.522823 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:47.523521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:47.530583 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:47.531030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:47.531812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:47.532247 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:47.658793 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:47.666904 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-204efa25-4b2c-4ae6-99e1-d8ca9ae7a94e tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1575 microversion: 2.1 time: 0.148788 Jun 03 09:22:47.667462 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 538/1089] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:47 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:22:48.683849 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:22:48.684385 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:22:48.690900 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:48.691371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:48.692170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:22:48.692604 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:22:48.826500 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:22:48.834492 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-04eb0a24-8e9b-4d53-a1e1-56ea1b5cec70 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1562 microversion: 2.1 time: 0.154557 Jun 03 09:22:48.835048 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 552/1090] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:22:48 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:23:11.116906 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:11.117546 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:11.119653 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=3 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:11.120327 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=10 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:11.127796 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:11.128612 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:11.129707 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:11.130153 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:11.155352 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-ba6f09a6-e203-4c89-8fc9-9db933fb0174 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/ips" status: 200 len: 150 microversion: 2.1 time: 0.042535 Jun 03 09:23:11.155963 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 539/1091] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jun 3 09:23:11 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:23:12.476913 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8bc0541-c9f3-412f-bd57-8b8d70289781"}} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:23:12.477961 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:12.480029 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=3 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:12.480827 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=11 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:12.486425 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:12.486886 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:12.487614 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:12.488074 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:12.722031 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-27198c4e-d765-44d3-8415-41bd3761372d tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "POST /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249362 Jun 03 09:23:12.722629 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 553/1092] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jun 3 09:23:12 2022] POST /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:23:20.295599 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:20.296129 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:20.302524 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:20.302970 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:20.303801 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:20.304240 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:20.386095 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.objects.instance [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lazy-loading 'services' on Instance uuid 86606859-da2d-4afd-8df2-5ed0cfcc0a0a {{(pid=117754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:23:20.457633 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6f4f1651-a01e-4874-8564-1d39844237bb tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments/f8bc0541-c9f3-412f-bd57-8b8d70289781" status: 202 len: 0 microversion: 2.1 time: 0.165946 Jun 03 09:23:20.458235 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 540/1093] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jun 3 09:23:20 2022] DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments/f8bc0541-c9f3-412f-bd57-8b8d70289781 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:23:20.468291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:20.469364 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:20.477714 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:20.478154 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:20.478928 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:20.479380 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:20.511687 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-92c8931f-0ac7-410e-bc6b-6600e236bfd4 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048200 Jun 03 09:23:20.512281 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 554/1094] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:23:20 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:23:21.524484 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:21.525497 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:21.532055 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.532506 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.533266 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.533705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.563108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-6734760c-034a-4737-99bf-bbb5207592e5 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043571 Jun 03 09:23:21.563638 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 541/1095] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jun 3 09:23:21 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:23:21.619416 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:21.619951 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:21.626371 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.626821 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.627581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.628050 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.651581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Going to try to terminate instance {{(pid=117753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:23:21.724110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-6205f8a0-8519-4608-9722-4c9c245ce7b9 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 204 len: 0 microversion: 2.1 time: 0.108479 Jun 03 09:23:21.724710 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 555/1096] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:23:21 2022] DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:23:21.733764 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:21.734408 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:21.741128 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.741581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.742347 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:21.742784 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:21.868538 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:23:21.876467 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-75b89ce9-e69a-4ac2-907c-ccc584262e69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1681 microversion: 2.1 time: 0.146590 Jun 03 09:23:21.877033 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 542/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:21 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:23:22.894086 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:22.894775 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:22.901294 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:22.901737 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:22.902485 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:22.903165 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:23.030093 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:23:23.037771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-0427cc9f-8eda-4077-9991-ebfe1c09860e tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1681 microversion: 2.1 time: 0.147892 Jun 03 09:23:23.038837 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 556/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:22 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:23:24.055193 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:24.055830 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:24.062283 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:24.062730 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:24.063489 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:24.063974 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:24.255109 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '757aa60ce15f44718b15532550e31a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63847d4652e547aaa4d7be37b0c38c52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:23:24.263685 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2fd792c2-4b5b-483a-a7ff-28709e32dfb7 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 200 len: 1681 microversion: 2.1 time: 0.212846 Jun 03 09:23:24.264296 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 543/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:24 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:23:24.566248 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-b56715e8-6c5d-46bd-bd54-42ce4f986797 req-c93c64d2-b687-4259-8faa-b56dd628cb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86606859-da2d-4afd-8df2-5ed0cfcc0a0a", "name": "network-vif-deleted", "tag": "eb1fd950-0167-431e-8233-3e8cc4f53538"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:23:24.576728 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b56715e8-6c5d-46bd-bd54-42ce4f986797 req-c93c64d2-b687-4259-8faa-b56dd628cb25 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:24.577435 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-b56715e8-6c5d-46bd-bd54-42ce4f986797 req-c93c64d2-b687-4259-8faa-b56dd628cb25 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:24.589272 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-b56715e8-6c5d-46bd-bd54-42ce4f986797 req-c93c64d2-b687-4259-8faa-b56dd628cb25 service nova] Creating event network-vif-deleted:eb1fd950-0167-431e-8233-3e8cc4f53538 for instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a on hv-cinder-81268 Jun 03 09:23:24.595139 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-b56715e8-6c5d-46bd-bd54-42ce4f986797 req-c93c64d2-b687-4259-8faa-b56dd628cb25 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Jun 03 09:23:24.595741 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 557/1100] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:23:25.281092 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:25.281705 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:25.288184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:25.288640 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:25.289438 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:25.289931 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:25.304017 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a HTTP/1.1 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:23:25.305686 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:25.307474 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '86606859-da2d-4afd-8df2-5ed0cfcc0a0a'} Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:25.308507 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:25.310272 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:25.311952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:25.311952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-12a526e6-15dc-443b-9d76-c971c816cad3 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 404 len: 111 microversion: 2.1 time: 0.030327 Jun 03 09:23:25.311952 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 544/1101] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:25 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:25.316744 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-dabbc77a-e879-42a5-a7dd-83adf7400f69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '.version_select at 0x7fd2b127dc10>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:25.335447 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-dabbc77a-e879-42a5-a7dd-83adf7400f69 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340299933" status: 202 len: 0 microversion: 2.1 time: 0.022158 Jun 03 09:23:25.336076 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 558/1102] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jun 3 09:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340299933 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:23:27.084894 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:27.085406 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:27.091881 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:27.092333 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:27.093085 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:27.093520 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:27.106621 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a HTTP/1.1 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:23:27.108173 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.109800 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '86606859-da2d-4afd-8df2-5ed0cfcc0a0a'} Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:27.110965 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.112657 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.114194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:27.114194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-1ffcc086-2427-477b-b30d-61d4476dde18 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 404 len: 111 microversion: 2.1 time: 0.028499 Jun 03 09:23:27.114194 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 545/1103] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:23:27 2022] DELETE /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:27.119262 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:27.120052 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 86606859-da2d-4afd-8df2-5ed0cfcc0a0a] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:27.126669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:27.127151 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:27.127946 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:27.128387 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:27.142057 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a HTTP/1.1 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:23:27.143789 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.145468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '86606859-da2d-4afd-8df2-5ed0cfcc0a0a'} Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:27.146618 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. Jun 03 09:23:27.148567 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:27.149985 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 86606859-da2d-4afd-8df2-5ed0cfcc0a0a could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:27.149985 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-d1c10e38-1451-45b0-867e-ed64e3ad6ebd tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a" status: 404 len: 111 microversion: 2.1 time: 0.030326 Jun 03 09:23:27.149985 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 559/1104] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:27 2022] GET /compute/v2.1/servers/86606859-da2d-4afd-8df2-5ed0cfcc0a0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:28.274099 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:28.274595 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:28.281209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.281649 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.282396 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.282825 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.295895 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 HTTP/1.1 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:23:28.297405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.299041 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '3d7abf4c-8902-44ec-a81d-b678f770aad1'} Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:28.300209 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.302108 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.305600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:28.305600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-e03d1163-5383-46cc-aed8-e34a97c59895 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 404 len: 111 microversion: 2.1 time: 0.029016 Jun 03 09:23:28.305600 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 546/1105] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:23:28 2022] DELETE /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:28.308711 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:28.310382 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 3d7abf4c-8902-44ec-a81d-b678f770aad1] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:28.316852 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.317365 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.318118 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.318550 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.331980 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 HTTP/1.1 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:23:28.333518 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.335705 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '3d7abf4c-8902-44ec-a81d-b678f770aad1'} Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:28.336836 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. Jun 03 09:23:28.338376 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.339883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 3d7abf4c-8902-44ec-a81d-b678f770aad1 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:28.339883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-323801f2-2a62-4327-b2e8-cabf96672630 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1" status: 404 len: 111 microversion: 2.1 time: 0.031656 Jun 03 09:23:28.339883 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 560/1106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:28 2022] GET /compute/v2.1/servers/3d7abf4c-8902-44ec-a81d-b678f770aad1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:28.343979 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:28.344473 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:28.350452 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.350893 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.351641 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.352100 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.364950 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 HTTP/1.1 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:23:28.366453 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.368184 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '027320be-7f45-4f12-ab40-557d0a196e66'} Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:28.369362 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.370959 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.372521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:28.372521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-c0f99fe8-6917-4baa-945f-8382dd4ddf3a tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 404 len: 111 microversion: 2.1 time: 0.027786 Jun 03 09:23:28.372521 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 547/1107] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:23:28 2022] DELETE /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:28.375896 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:28.376504 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 027320be-7f45-4f12-ab40-557d0a196e66] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:28.382934 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.383374 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.384148 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:28.384581 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:28.398083 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 HTTP/1.1 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:23:28.399559 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.401238 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '027320be-7f45-4f12-ab40-557d0a196e66'} Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:28.402394 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. Jun 03 09:23:28.404313 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:28.408113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 027320be-7f45-4f12-ab40-557d0a196e66 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:28.408113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-20d29d42-baa8-4542-81e4-d4cf2945c561 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66" status: 404 len: 111 microversion: 2.1 time: 0.028941 Jun 03 09:23:28.408113 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 561/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:28 2022] GET /compute/v2.1/servers/027320be-7f45-4f12-ab40-557d0a196e66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:29.531405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:29.531942 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:29.539009 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:29.539457 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:29.540253 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:29.540697 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:29.553872 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.wsgi [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: request: DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 HTTP/1.1 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept: application/json Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Accept-Encoding: identity Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Connection: close Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Length: 0 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Content-Type: application/json Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Host: 10.222.0.61 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Openstack-System-Scope: None Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Id: None Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Domain-Name: None Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Identity-Status: Confirmed Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Is-Admin-Project: True Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Id: default Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Domain-Name: Default Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Role: member,reader Jun 03 09:23:29.555461 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Roles: member,reader Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Id: default Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Domain-Name: Default Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: method: > Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: exception: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.557141 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: action_args: {'id': '6489d030-236d-40ce-829b-95aecdf19ff7'} Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:29.558219 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.559737 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.561405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. {{(pid=117754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:29.561405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-2f8b4622-40e3-4932-9c99-e95e0b7c3400 tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 404 len: 111 microversion: 2.1 time: 0.029603 Jun 03 09:23:29.561405 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 548/1109] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:23:29 2022] DELETE /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:23:29.565065 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:23:29.565669 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] [instance: 6489d030-236d-40ce-829b-95aecdf19ff7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:23:29.572592 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:29.573033 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:29.573771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:23:29.574198 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:23:29.587717 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] HTTP exception thrown: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Request method failure captured: Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 HTTP/1.1 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdFY5N2sKj8DbSzHYl5gp5l_ALuQVwXRGQM6qhzCS8aMsxX1ZPLqAEqAo1TFUwxJjt0BC6lCGk0BySSfjBHYyt_o3PYJ1WvNAo_NAtJIlV-jbIrvI1aJNmGkFyZEft5Q1bwCzjQh4RROHtrAAoBhcL9EN67XCk4VdmhOXQJdISwG_5Q Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:23:29.589221 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63847d4652e547aaa4d7be37b0c38c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 63847d4652e547aaa4d7be37b0c38c52 Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-885152595 Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 757aa60ce15f44718b15532550e31a2e Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-AttachVolumeNegativeTest-885152595-project Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.590841 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': '6489d030-236d-40ce-829b-95aecdf19ff7'} Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:23:29.591944 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. Jun 03 09:23:29.593506 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:23:29.595044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] Returning 404 to user: Instance 6489d030-236d-40ce-829b-95aecdf19ff7 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:23:29.595044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-153daff4-32d1-4104-953f-93d9f84a887f tempest-AttachVolumeNegativeTest-885152595 tempest-AttachVolumeNegativeTest-885152595-project] 10.222.0.61 "GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7" status: 404 len: 111 microversion: 2.1 time: 0.029303 Jun 03 09:23:29.595044 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 562/1110] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:23:29 2022] GET /compute/v2.1/servers/6489d030-236d-40ce-829b-95aecdf19ff7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:24:25.948030 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:25.948579 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:24:25.951172 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.951592 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_api:SELECT=20 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.952366 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG dbcounter [-] [117753] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.952525 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG dbcounter [-] [117754] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.957902 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:25.958432 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:25.959186 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:25.961934 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:26.001450 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Going to try to terminate instance {{(pid=117754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:24:26.091962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-427405f9-96eb-45cd-a5f6-b683a29aca85 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 204 len: 0 microversion: 2.1 time: 0.147513 Jun 03 09:24:26.092211 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-652eac22-6dfa-42c4-8e94-27de45275832 req-8e3d71bd-0570-4ea3-a6b5-975e08b3560e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:24:26.092983 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 549/1111] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jun 3 09:24:25 2022] DELETE /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:24:26.100685 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-652eac22-6dfa-42c4-8e94-27de45275832 req-8e3d71bd-0570-4ea3-a6b5-975e08b3560e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:26.101183 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-652eac22-6dfa-42c4-8e94-27de45275832 req-8e3d71bd-0570-4ea3-a6b5-975e08b3560e service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:26.103167 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:26.104962 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:24:26.112500 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:26.113002 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:26.113463 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-652eac22-6dfa-42c4-8e94-27de45275832 req-8e3d71bd-0570-4ea3-a6b5-975e08b3560e service nova] Creating event network-changed:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:24:26.113969 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:26.114402 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:26.119170 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-652eac22-6dfa-42c4-8e94-27de45275832 req-8e3d71bd-0570-4ea3-a6b5-975e08b3560e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173063 Jun 03 09:24:26.120373 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 563/1112] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:24:26.256812 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:24:26.264651 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-3e32fc00-ef1f-41a4-8132-47b0cc7e618a tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.166585 Jun 03 09:24:26.265303 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 550/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:24:26 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:24:27.283240 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:27.283959 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:24:27.290169 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:27.290489 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:27.291235 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:27.292189 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:27.483851 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.policy [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117753) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:24:27.491468 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-8e4c1dec-bf6e-4728-b987-d0625f0cd102 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1568 microversion: 2.1 time: 0.212940 Jun 03 09:24:27.492206 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 564/1114] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:24:27 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:24:28.512509 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:28.513384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.compute.api [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117754) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:24:28.520364 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:28.520905 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:28.521761 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:28.522295 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG oslo_concurrency.lockutils [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:28.566825 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [req-ca603718-5dc2-4a65-86d2-c2b9914c561b req-adb2ef32-3363-476d-803a-b42bc44c9b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8dc31b7-1cbc-4216-acf1-aca86ba83bb7", "name": "network-vif-deleted", "tag": "a5257e6c-08ee-4480-9f22-5fd0d5203312"}]} {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:24:28.577146 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ca603718-5dc2-4a65-86d2-c2b9914c561b req-adb2ef32-3363-476d-803a-b42bc44c9b42 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:28.577597 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [req-ca603718-5dc2-4a65-86d2-c2b9914c561b req-adb2ef32-3363-476d-803a-b42bc44c9b42 service nova] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:28.589054 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.compute.server_external_events [req-ca603718-5dc2-4a65-86d2-c2b9914c561b req-adb2ef32-3363-476d-803a-b42bc44c9b42 service nova] Creating event network-vif-deleted:a5257e6c-08ee-4480-9f22-5fd0d5203312 for instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 on hv-cinder-81268 Jun 03 09:24:28.593838 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [req-ca603718-5dc2-4a65-86d2-c2b9914c561b req-adb2ef32-3363-476d-803a-b42bc44c9b42 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 Jun 03 09:24:28.594437 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 565/1115] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jun 3 09:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:24:28.595226 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.policy [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baba2d9768f4578aeda5f311964229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39196d3b3d514f458e0657ccafaf4134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117754) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:24:28.603035 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-18b7026e-0d3a-4105-9c81-40c036c69dd3 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 200 len: 1382 microversion: 2.1 time: 0.095376 Jun 03 09:24:28.603581 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 551/1116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:24:28 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:24:29.620979 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '>' {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:29.621678 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.compute.api [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [instance: d8dc31b7-1cbc-4216-acf1-aca86ba83bb7] Fetching instance by UUID {{(pid=117753) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:24:29.628110 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:29.628589 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:29.629490 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:24:29.629927 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG oslo_concurrency.lockutils [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Lock "3d8a6cbe-b878-4842-b833-a44ee6ffbdfc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:24:29.643358 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.wsgi [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] HTTP exception thrown: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Request method failure captured: Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: request: GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 HTTP/1.1 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept: application/json Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Accept-Encoding: identity Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Connection: close Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Length: 0 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Content-Type: application/json Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Host: 10.222.0.61 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Openstack-System-Scope: None Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: User-Agent: python-urllib3/1.26.9 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Auth-Token: gAAAAABimdIPn3g78UXnqz7AXPv_qVrEP70B8QNAXuwpqx0uOPN4MRc7wX71iNFB4V_QDrYb5q5lMD9oYT0gvFrbCc4mMdn-o5skXIXIjrUBE3-xxG8uEA9KeZHRk_bZHkNCKgiYwC0456FOjW-VmjTZXo2o5lYpnKuOfqzCjX_kCpI8eamjxik Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Id: None Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Domain-Name: None Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Identity-Status: Confirmed Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Is-Admin-Project: True Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Id: default Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Domain-Name: Default Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Id: 39196d3b3d514f458e0657ccafaf4134 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Project-Name: tempest-TestShelveInstance-147910 Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Role: member,reader Jun 03 09:24:29.644956 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Roles: member,reader Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/39196d3b3d514f458e0657ccafaf4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_39196d3b3d514f458e0657ccafaf4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/39196d3b3d514f458e0657ccafaf4134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/39196d3b3d514f458e0657ccafaf4134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant: tempest-TestShelveInstance-147910 Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Id: 39196d3b3d514f458e0657ccafaf4134 Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-Tenant-Name: tempest-TestShelveInstance-147910 Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User: tempest-TestShelveInstance-147910-project Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Id: default Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Domain-Name: Default Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Id: 9baba2d9768f4578aeda5f311964229f Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: X-User-Name: tempest-TestShelveInstance-147910-project Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: method: > Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: exception: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: action_args: {'id': 'd8dc31b7-1cbc-4216-acf1-aca86ba83bb7'} Jun 03 09:24:29.646752 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: {{(pid=117753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:24:29.647771 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. Jun 03 09:24:29.649212 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: ERROR nova.api.openstack.wsgi Jun 03 09:24:29.650600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: DEBUG nova.api.openstack.wsgi [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Returning 404 to user: Instance d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 could not be found. {{(pid=117753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:24:29.650600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO nova.api.openstack.requestlog [None req-61ec06e8-6d54-4753-9265-8286654e8ef9 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7" status: 404 len: 111 microversion: 2.1 time: 0.030065 Jun 03 09:24:29.650600 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: [pid: 117753|app: 0|req: 566/1117] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jun 3 09:24:29 2022] GET /compute/v2.1/servers/d8dc31b7-1cbc-4216-acf1-aca86ba83bb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:24:29.806367 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: DEBUG nova.api.openstack.wsgi [None req-cbe06121-f5dd-4794-8c19-7055e5609f98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] Calling method '.version_select at 0x7fd2b16fbc10>' {{(pid=117754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:24:29.810421 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbe06121-f5dd-4794-8c19-7055e5609f98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [ed78fbe1-88d5-4dfc-9ef5-010b108e8325] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 09:24:30.818094 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbe06121-f5dd-4794-8c19-7055e5609f98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] [ed78fbe1-88d5-4dfc-9ef5-010b108e8325] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 45546. Jun 03 09:24:30.836826 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO nova.api.openstack.requestlog [None req-cbe06121-f5dd-4794-8c19-7055e5609f98 tempest-TestShelveInstance-147910 tempest-TestShelveInstance-147910-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-333925914" status: 202 len: 0 microversion: 2.1 time: 1.035009 Jun 03 09:24:30.837395 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: [pid: 117754|app: 0|req: 552/1118] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jun 3 09:24:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-333925914 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:25:03.842741 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:25:03.843448 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:26:32.395729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:26:32.396386 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:28:02.490721 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:28:02.491445 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:28:23.850960 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:28:23.851567 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:29:40.249987 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:29:40.250637 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:29:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:29:52.404462 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:29:52.405043 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:29:55.181790 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:29:55.182291 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:30:17.165852 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:30:17.166384 dv-cinder-812685-8-iscsi devstack@n-api.service[117754]: Fri Jun 3 09:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 09:31:22.499729 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 09:31:22.500316 dv-cinder-812685-8-iscsi devstack@n-api.service[117753]: Fri Jun 3 09:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!